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ABSTRACT 

The "Bread and Butterflies" series of 15 television 
programs on career development for 9-to-12-year-olds was evaluated. 
The evaluation sought to answer these questions: Has the program 
appealing to the students? Did the students comprehend the program? 
Here the educational objectives met by the television prograas aloae? 
and were the educational objectives met by the television program 
plus the classroom activities? The methodology of the evaluation 
included student questionnaires, student interviews, student critics, 
teacher questionnaires, expert judgement, attention measures, and 
observers. The series of television programs was proclaimed 
successful only if the goal was the providing of an affective 
stimulus. No effect was observed on the achievement of specific and 
particular, behaviorally-def ined educational objectives. («H) 
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CHAPTER I. INTROmJCTION AND OVERVIEW 



bfLead and battt^^lltA is a career development project 
for nine-to-twelve-year-olds. It consists of fifteen IS- 
minute color television programs and associated classroom 
materials for use in North American schools. According to 
its designers, bn.zad and btittzfLitit& is intended to help 
students explore the relationship between the r lives and 
the world of work. Ths series focuses on the individual's 
perception of himself within the economic system, rather 
than solely on information related to occupations and work 
activities. Most of the programs are open-ended encounters, 
encouraging viewer involvement in problem-solving and 
decision-making, both program-related and personal. 

Developed and produced over a two-year period, the pro- 
ject was supported by a consortium of 34 agencies, including 
state departments of education, ETV networks, ETV commissions, 
and local educational agencies. Additional support was pro- 
vided by txxon Corporation. 
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Content and production experts held a series of meetings 
to establish the project's philosophy and to design the IS 
lessons in the series. Agencies supporting the project, and 
other experts, were given the op^portunity for periodic re- 
view of the written mateFials as these were developed. 

During this design phase of bfitad and bu.tte.fL^tle.A, the 
Agency for Instructional Television (AIT) engaged Educational 
Testing Service (ETS) to design and conduct the major portion 
of the evaluation activities thought necessary for the pro- 
duction phase of the project. Although AIT itself could 
have carried out many of the evaluation activities, it seemed 
more appropriate for the integrity of the project that an 
independent agency begin to examine the purpose and effects 
of tne materials, especially the television programs. The 
details of the evaluation were developed by ETS in cooperation 
with AIT and the project design staff. 

The thrust of the proposed activities was "formative" 
in nature. That is, the evaluation was designed primarily 
to obtain information on the effectiveness of the project's 
components quickly enough to allow the content designers 
and material producers to make indicated changes and improve- 
ments. Evaluation data were to be used in making decisions 
about the relative acceptability of the programs and to 
isolate deficiencies that could be corrected. 



Given these needs for evaluative inforaation, the task 
of ETS was to provide maxiaum useful data, given certain 
restrictions of time and budget. Production and delivery 
schedules had not been established for the convenience of 
evaluation; this limited the extent to which any single 
program could be examined. This also limited the number of 
programs for which any e aation could be conducted. Only 
the first six of the project's fifteen programs could be 
included, but the evaluation was constructed so that feed- 
back on the six earliest productions could be used not only 
in improving those programs, but also in correcting and pre- 
venting foreseeable deficiencies in the remaining nine programs. 

The outlines of the first six programs, thefr objectives, 
and the preliminary versions were submitted to ETS during 
the Fall and Winter of 1973-74. On the basis of these materials 
and information gathered during additional meetings, the 
staff at ETS designed and delivered to AIT the rough-draft 
copies of instruments to be used in field evaluation of the 
programs. AIT then arranged for the reproduction, distribution, 
and administration of the instruments to selected classrooms 
across the country. Mort than 2,000 students in almost 100 
classrooms were involved in the evaluation. The completed 
forms were returned to ETS for analysis, and the results of 
this analysis were reported back to AIT for use in making 
format ivc'level dcicisions about the programs. 
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The remainder of this report provides a suafflaty of the 
approaches used to gather the data, and some of the particular 
results that were obtain:d. In many cases the data presented 
in this report are now obsolete, since needed changes that 
were revealed have been made in the prograas. Thus the 
emphasis is on the evaluation process, and the substantive 
data !tre, for the most part, not reported. 



CHAPTER 1 1 . FOCUS AND METHOMLOGY 



There were four areas of concern for the bfie.CLd and 
biitttfL^Zlti evaluation activities. These vere: 

A. Pld tht studtntA tompi^hzHd the. pn.ogKam? If students 
do not understand what is happening in the progran, no learn- 
ing can take place. Comprehension of the details of the 
program, therefore, was the fundamental concern. 

S. Wa^ the pKogiam appealing to tkz ^tudzntsf Again, 
if students were not attracted to the program, it seemed 
unlikely that maximal learning would occur. So the concern 
was whether or not students watched the program, and whether 
^^^y i iked what they saw. 

C. Wc^e tht tdutatlonat ab/cct-tvci met by the tzZevislon 
p^ogxam alone? Although the b^ead and butte^^Zie& package 
was designed to include pre-and post-program activities, 
suggested in the teachers* curriculum guide, it was the 
concern of the producers that the television program be able 



to stand alone, if possible. As a result, one part ot the 
evaluation focused on the imfsctliatP effects of merely view<- 
ing the program. The focus was on the attainment of a list 
of specific^ behaviorally-def incd educational objectives 
for each program, which had been prepared in advance during 
meetings of the design and evaluation staffs. 



V, Wcfie. tk& educational objtctivth mtt by the. tett\f4.6lan 
pficgtam ptui the. cCa&^fiocm actlvltle.&? Using the saae list 
of educational objectives as a standard, evaluators examined 
the specific effects of the classroom activities which fol- 
lowed the viewing of the program. Because of practical sched- 
uling difficulties, investigation was limited to the effects 
of the first 15 minutes of the post-program activities. 



A fifth area to be evaluated was the curriculum guide 

itself, but this study was commissioned separately and is 

1 

not included in this report. 



1 

A special study of the curriculum guide for teachers was 
commissioned by AIT and took place in the Phoenix area during 
March, 1974. The study was conducted by Bill Raymond, Director 
of Planning and Special Projects, and Carolyn Raymond, Director 
of the Center for Career Development, both of the Mesa, Arizona, 
Public Schools. A panel of eight teachers, appropriate to 
the target audiences, analyzed a draft version of the guide 
in conjunction with each television program. The resulting 
report gave both specific and general suggestions for the 
organisation and content of the curriculum guide, and those 
suggestions were taken into account as the final version 
was developed. 
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The variety of information desired, and the rapidity 
with which it was; needed, suggested to ETS that a multi- 
faceted approach to data collection would have the greatest 
utility. Since limitations of time and finances prevented 
the development of any particular objective testing instru- 
ment to a high degree of precision, a multi-faceted approach 
had the advantage of providing numerous sources and methods 
of data collection such that the weakness of one source or 
method could be compensated for by the strength of another 
if the information from each were combined in an optimal 
manner. Seven such facets were identified. 

A. Student Questionnaires . The students were admin- 
istered paper-and-penc i 1 questionnaires either directly fol- 
lowing the program, or following the program plus 15 minutes 
of classroom activities. A control group of children who had 
not seen the program also completed the questionnaire. The 
strength of this technique is its direct contact with the 
target audience, and its capacity for broad sampling of this 
audience in a standardised manner; its weakness is the lack 
of proficiency with the written word typical of nine-to- 
twelve- year -olds. 

^' Student Interviews . After the program four or five 
students were selected from each classroom, taken aside, and 
interviewed (usually by a local teacher or television uttli- 
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zation specialist). This technique overcame the writing 
problems inherent in the Student Questionnaire, but was 
weak in its reliance on the interpretations (and reporting 
skills) of the interviewers. 

C. Student Critics . One class of fifth graders front 
a local school was utilised by the ETS staff, in an atteapt 
to get a more "sophisticated" student reaction to several of 
the programs. The class was shown a number of the programs; 
it was hoped that reactions thus would be determined more 
by the program content and less by the newness of the expe- 
rience. This sophistication was, of course, an advantage in 
that it simulated the eventual experiences of students who 
will be seeing the entire series- however, the small sample 
(about 20) from an atypical location (Princeton, New Jersey) 
was recognized as a considerable limitation. 

l>. Teacher Questionnaires . The teachers of those classes 
completing the Student Questionnaires and Student Interviews 
were used as another source of information about the success 
of each program. Although it is an indirect means of data 
collection to ask teachers to assess student reaction, the 
teacher knows the children well and is able to communicate 
his/her insights with some skill. In addition, the teacher 
often operates as a gatekeeper for the program's use, so 
such opinions arc critical. 
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E. Hxpert Judgment . In the absence of a better term, 
this one was use«i to designate a place in the evaluation 
procedure at which the professional stuff who were conduct- 
ing the evaluation could register their own impressions and 
reactions. This facet was intenu?d to temper the influences 
of the more objective techniques being used which, although 
objective, were limited in the scope of their coverage. 

V. Attention Measures . Developed by AIT and playing 
a significant role in the evaluation were the Attention 
Measures taken while the students in some classrooms watched 
the program. The strength of this technique is its complete 
objectivity, the weakness lies in the fact that the effective 
relationship between attention and actual comprehension 
or learning is only poorly understood. 

G. Observers . None of the previous measures were 
directed specifically toward watching the entire class, as 
a group, for appropriate or unusual reactions. Observers 
present in each experimental classroom watched the students 
viewing the program, and reported their impressions. 

Each of these sources of information, then, was employed 
to the extent and with the emphasis judged to be appropriate 
to each of the four specific areas of concern on which 
evaluation focused. Each area of concern was studied through 
several of the seven data collection approaches, giving 
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ilecision-mukers access to a variety of data sources. 



The following table presents a summary of the information 
sought about bfiead and bu.tte.fi ill laateriais and the ♦'aultl- 
faceteJ^ approach towards data collection. 



TABLE 1. Evaluation Design 



AREAS OF CONCERN 



[ Objectives: 
, Objectives: Television 
MirniODS Attention and Television antt 

Comprehension Appeal only Fol!ow«up 



(A) Student 

Questionnaires 


X 


X 


X 


X 


(B) Student 

I nterv ietos 


X 


X 


X 


X 


IC) Student 
Critics 


X 


X 






(H) Teacher 

Quest lonna ires 


X 


X 


X 


X 


(K) Kxpert 

Judgment s 




X 


X 




fF) Attention 
Measures 


X 


X 






(*'<) ObservfTS 




X 
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CHAPTER III. THE SAMPLE POPULATION 



Cooperation of the consortium agencies was soughc in 
the sample selection process. Those educational and tele- 
vision agencies willing to participate in the field testing 
of completed bxead and butter jJ£-teA programs were asked to 
select classrooms that would be representative of their 
normal school television viewing audience. In each location, 
sets of three equivalent representative classrooros were 
grouped for comparative evaluation purposes. This selection 
process did not seek a random sample of all fourth, fifth 
and sixth grade students; rather, the planned use of the 
programs suggested that students representative of the 
eventual television audience would be a more appropriate 
sample for evaluation purposes. 

The request also was made that sample programs be shown 
under normal school television viewing conditions; that is, 
if children normally viewed in black-and-white, the field 
testing also should be in black-and-white. This condition 
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was not always adhcreU to^ but diU not seem to bias the 
results. 

Each participating agency received a copy of the pre- 
liminary version of a program on video tape, (Texas, an 
exception, evaluated a program on film.) Agencies also 
received multiple copies of the ETS- and AIT-designed eval- 
uation instruments and detailed instructions for classroom 
administration. Follow-up telephone calls or site-visits 
clarified ambiguities or misunderstandings regarding the 
evaluation procedures * 

Fifteen agencies in fourteen consortium states volun- 
tarily paretic ipated in the field testing and evaluation of 
bn.zad and vuttQ.n.^llzs . Ninety-four classrooms and more 
than 2 , 000 ' students were involved. These students included 
American Indians, Spanish-surnamed children, blacks and 
whites. Their economic and social statu?* ranged from below 
poverty level to upper class* The sample classrooms were 
located in rural and suburban areas, small towns and large 
cities, from Vermont to Arizona* Emphasis was placed on 
working with fifth grade students and, for the most part, 
the sample was comprised of 10-year-olds* Occasionally 
a third or seventh grade class was included; fourth and 
sixth graders appeared with greater frequency. Nevertheless 
the great majority of the students were from the fifth grade 



The geographic spread and size of the 5;afttplc are noted 
in the following table: 



TABLE 2. POPULATION SAMPLED 

rro|:ram NiltMU-y No. of Classes So. of StuJcnt!* s| 

Treasure Hunt Arizona State Department ef fUucatiDU 6 135 

t>ranj:«> County Public Schools 11 . 

Orlando , Mor iJa 

Masisachu^ett 5 Executive Committee 8 
for n due at ional Tclevi *i i on and 
Di/iHlon of Occupational {tflucation, 
{lepartwent of liducation 

PROGRAM TOTAL 25 525 

People Seed People Io«a Educational Broadcasting Network 



North Carolina State Uepurtmcnt of 
Lducat ion 



3 50 
6 1.^7 



Educational Communications Board of ^ 131 

Ki 5C ons in 



PROGRAM TOTAL 



IS • 5I» 



DcctsionH. Decisions Mi sfii sHi,>pl Authority for hducatioual 6 120 

Television 

Pi tt sburgh , ' enn sylvan i a 

Vermont State hepartment of Hducation 6 118 



PROGRAM TOTAL 



18 565 



Me, Myself and Maybe Iowa Kducational Broadcasting Network 3 82 



PROHKAM TOTAL 

Success Story KViZ-TV 

ClevelanJ , {)hio 



PkOCJRAM TOTAL 

OVERALL TOTAL 
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59 



Ohio State I^epartment of i:ducation 3 

New York Stat.* Department of l:Jucation b 120 

(film) Uducationul Service Center, ^ ^"^^ 
Ref^ion 17, Lubbock. Texas 



18 432 
155 



Tennessee State I»epartment of rUucation 6 153 

WKVIUTV ^ ^ 

Mo rgant own , West V i rg in i a 



IH U.t 
94 2^080 



CHAPTER IV. PROGRAM DESCRIPTIONS 



The five bfLCad and battQ.ft^liQ.i prograias undergoing 
extensive ealuation by ETS are summarized in the following 
pages. (The specific educational objectives for each of 
them can be found in Appendix A.) 

A. Treasure Hunt 

Theme: Sel f- Independence and the Economic System. 

The carnival is in town, the music is exciting, the 
lights bright, and the rides costly. Brnie, Monica, and 
Bill go their separate ways to finance the experience. In 
interwoven stories, the children face the tasks, frustrations, 



One of the first programs completed and made available to 
f-TS for evaluation was entitled "Why Work." Evaluation 
instruments were designed and preparations were underway to 
take the material into classrooms. However, before data 
could be collected, this program was shown at a meeting of 
representatives of the consortium agencies. In discussions 
following this presentation, a "'.ess formal evaluation" 
process took place and the consortium representatives, for 
a variety of reasons, rejected this program in its entirety. 
Although this was not an evaluation activity conducted by 
liTS, it is, nonetheless, an evaluation process and is reported 
here for the record. It did result in change in the series; 
a new program was developed and pioduced to accomplish some 
of the same objectives embodied in the original "Why Work," 
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and satisfactions ot* earning money. When they reconvene at 
the carnival, all three have money. Monica and Ernie are 
enthusiastic over their money-making ventures, while Bill 
is surly and close-mouthed about the source of his funds. 
The program explores the process of producing income, and 
demonstrates ways of participating in the economic system. 

B, People Need People 

Theme: Interdependency of Workers 

People need people, from the split-second teamwork of 
trapeze artists to the care and support of one friend for 
another, from the cooperation of construction workers to the 
finely-tuned execution of a quarterback sneak. Complete 
independence constantly is being thwarted by an individual's 
need to gain social acceptance, personal satisfaction, and 
financial security. The program helps students understand 
the importance of working together, and helps to increase 
the effectiveness of their interdependent relationships. 

C . Decisions, Decisions 
Theme: Decision Making 

Tommy is a new boy in town whose first friend is Joey. 
Joey turns out to be inept and unpopular with his classmates. 
Tommy, however, is wel 1 -received oy his new mates and wants 
very much to sustain his popularity. When Joey asks Tommy 
in front of the group to share in a week-end project. Tommy 
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"TREASURE HUNT" 



Some responses from the Student Questionnaire: 



Item: Hot/O could you. OJi youK ^\lznd6 zaKn. eight 
dollafLSt 

Answers: I would fix a broken thing. 

Steal it from your brother. 

Play cards with my Dad. 

Ask for my alownes. 

Item: The pafit^ th& p/iog^am I mutd change. aA£. . 

Answers: I would put more kids in there. 

that they should tell if Bill stole the 
money after. 

that you should end it more unsuspiciously. 

the part where that girl at the market said 
mean things. Sort of. 

I am not an expert doD*t ask me because 
I don't know. 

Opinions on the best part of the program included 
"Ernie washing the dog" as the most popular response, 
followed by forms of "seeing the kids make money," 
or "the carnival." 
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must deciile whether he can risk his continued friendship with 
Joey. The program demonstrates the decision-making process, 
focusing on the factors that influence decisions (emotions, 
values, etc.) and the consequences of those decisions. 

D. Mc^ Myself, and Maybe 
Theme; Self-Clarification 

Eleven-year-old DeAnne lar.Ks self-confidence. She wants 
very much to be a part of the pantoai©e game that her class 
enjoys, but she can*t bring herself to volunteer. Her Aunt 
Cathy moves into town to begin a new career. She is sensitive 
to DeAnne*s reticent behavior and learns of DeAnne*s interest 
in art. She buys her niece a macraro€ kit, and bundles of 
little strings and beads begin to take shape. New ideas are 
also taking shape "You arc what you do," and "If you don't 
take a chance then you don't get a chance." Eventually the 
"I want to" side of DcAnnc conquers the "I*m afraid to" side, 
and her pantomime performance and macrame sK' 1 11 s win approval. 
The program is intended to increase students' clarification 
and acceptance of themselves, particularly their evolving 
abilities and aspirations. 

n . Success Story 
Theme: What is Success? 

This is a true story about Dave who has been interested 
in defining success for himself most of his life. When he 
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was awing up on his father's farm, he enjoyed drawing, 
but his father thought it was a waste of time. When Dave 
was drafted he was able to decide for himself what he wanted 
to do In the Army. The challenge of having to pass tests, 
and of actually choosing what he wanted to be, made a change 
in Have, ile began to define success in his own teras, not 
in someone else*s. Today Dave owns a leather shop where he 
makes and sells his own work. Success for Dave is a personal 
tiling, something he has figured out for himself. The program 
explores the various ways to define success, emphasizing the 
future implications of one's personal definition of the concept* 



CHAPTER V. FOUR AREAS OF CONCERN! THE FINDINGS 



First Question: DID THE STUDENTS COMPREHEND THE PROGRAM? 
Treasure Hunt 

Comprehension was tested by items on the Student 
Questionnaire such as: 'Xheck the box which best explains 
why Monica lowered the price of her cards," and "Bill, 
Ernie and Monica had to think about many things before they 
started to get money for the carnival. (Indicate which, 
such as 'cost of materials,' 'how long it would take,' etc.)*" 
The Student Interview included questions such as: "How did 
Ernie get the idea of washing dogs to earn money?" The 
results from virtually all sources indicated excellent and 
detailed comprehension of the story line by the great majority 
of students. It should be noted here that over half of the 
students reported a belief that Bill got his money by 
stealing it, even though the story is non-committal on this 
point . 
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The Teacher (Questionnaire asked, ''Were the topic, 
content, and vocabulary levels of this program appropriate 
for your class?** With 25 teachers responding, 20 responded 
**yes,** two said *'don't know," while one said "no«" 

People Need People 

From the Teacher Questionnaire, with 15 teachers re- 
sponding, 13 found the topic, content and vocabulary appro- 
priate, while two did not. 

A post-prograp class discussion revealed that the Student 
Critics could recite the theme, as well as a number of spec- 
ific statements from the program, indicating a good degree 
of comprehension. No confusion about this relatively 
straightforward theme was detected. 

Decisions, Decisions 

All of the 16 participating teachers indicated that they 
found the topic, content, and vocabulary appropriate. 

From the Student Questionnaire, which included questions, 
like the examples below, excellent comprehension was indicated 
for the greatest part of the program: "Tommy had several 
goals in the program--things he wanted. Check the statement 
(i.e., buy a horse, get good grades, etc.)." "Check the 
statements that tell how Tommy tried to get out of making his 
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"PEOPLE NEED PEOPLE" 



Some responses from the Student Questionnaire: 



Item: 



Answers : 



Item: 
Answers : 



Wz alt nt6.d othzfi ptoplz to tivt ouk tsfZfitfdatf 
llvc^. Think oi yt^tz^diiy and name, e,cLck 
f^txion on nitkom you depended ^o^i iomttk'ing^ 

I depend on Mom to get me up, but she didn't 
yesterday. 

Mike Patton he played catch with me (I couJtd 
not play by myself). 

JiiB, Mike, My sister Cissy- All the people 
on ray baseball team to catch a pop. 

The be.6t pa^t oi the. pfiog^am ^^i...... 

the acrobats because they didn*t depend on 
anybody. 

the hole thing. 

when the girl helped the blind. That's nice. 



In general, the responses grouped under specific 
scenes or parts ("the blind boy," "the football game"), 
and abstract understandings ("people all depended on 
each other," "to help people"). 
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decision (asked his mother to lie for liim, etc.)." 
Me, Myself, and Maybe 

Seventeen teachers responded to the question about 
appropriateness of topic, content, and vocabulnry. Sixteen 
replied favorably, one unfavorably. Cosprehension also 
appeared to be high, based on the number of appropriate 
student responses to items such as "List some activities 
DeAnne did not do so well," and "What were some things DeAnne 
discovered she could do?" These appeared both on the Student 
Questionnaire and in the Student Interview; resulting data 
showed uniformly good results. 

Success 

Fifteen of the sixteen teachers considered the topic, 
content, and vocabulary appropriate, and one reported "don't 
know." 

rom the Student Critics, however, came evidence of 
considerable initial confusion about the fact that Dave was 
really the owner of the leather shop. At least one student 
in this small group also reported confusion about the name 
of the shop "The Cow»s Outside." These areas subsequently 
were tested in the Student Interview; ownership of the shop, 
but not the name, was found to be confusing and at least 
momentarily distracting. (This part of the program subsequently 
was changed to clarify the point.) 



Second Question: WAS THE PROGRAM APPEALING TO THE STUDENTS? 

THEY LIKE IT? 

Treasure Hunt 

5 

The Attention Measures indicated high and consistent 
Interest in this program, virtually incapable of iaprovement. 

(Fee figure 1 ) , 

Two items from the Teacher Questionnaire also provided 
data on this question: "How would you rate ; ar students* 
interest in the program?" and "Judged with other school 
television programs you have used» this program is..." 
"On a five-point scale« 20 out of 25 teachers rated this 
program in the top two categories in response to both of 
these questions. 

The Student Critics were very enthusiastic about this 
program . 

People Need People 

While not as high as "Treasure Hunt," the Attention 
Measures appeared acceptably high, with two noticeable dips 
at the transition points between the three sections of this 
program. (See figure 2.) These two lapses in attention 
were not regarded as serious or in need of correction, be- 
cause they did, in fact, occur during the transitional periods 

3 

For a further explanation of the methodology, see appendix C. 
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f i a r c 1 . 



o 



> 

pa 

O 



1^ 



.^Monica at home with sister 



Open t ng 

Printing Press/ money 
Dollar bill through winUow* 

Three k ids t al king 



Throe kids walking through 
carnival 

Cut to Ernie 
Ernie in front of dog salon 



lirnie knocking on doors with tub 
in hand-Bill with him 



Man answers door 



^ Grocery Store sequence 



^Intercuts of Ernie washing dog 
and Monica printing cards 



Man comes out -gi ves Em ie 
extra dolJar 

$1*50 § $KaO signs 
Monica selling card packet sequence 

Bi 1 1 comes over 

Bi 1 1 departs 

^ Return to carnival 

Kids running to spend money 



3^ iind^ Closing Credits 




{Opening 
^ i rapti^zt' s tMit ^ ^ 



Stop act Loii-lit le 
rrans i t ion with stills 



Fuotbrill iiractico sequence 



Football 1 game sequence 



St op ac t ion 

Transition with stills 



Carrying tank 



^ Telephone Co. worker sequence 



Driving truck 



Cutting cable 
Stop action 

Transition with stills 
Violin pract i ce 



Playing in leaves while 
walking home 

Slow motion running 
Trapeze 

Stop action - find 
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and seemed to serve as a kind of breather for the attentive 
student. 

FiOin the Student Critics came the reaction that they 
did not like this program as much as "Decisions, Decisions" 
(seen previously) but that it was still satisfactory. They 
did comment on the fact that there was a great deal of 

♦ 

repet i t ion . 

On the two relevant items from the Teacher Questionnaire 
(as above), with IS teachers reporting, 14 rated the program 
in the top two of the five categories. 

Decisions, Decisions 

The Attention Measures showed very high interest through- 
out, with one dramatic exception. (See figure 3.) During 
what became known as the "bedroom scene," when Tommy*s mother 
talks to him at length about the difficulties of decision- 
making, the attention level dropped to a point where about 
one-third of the students were not looking at the screen. 
(This section subsequently has been redone, presumably with 
more visual stimulation.) 

From the Student Interview came evidence again that the 
bedroom scene was considered to be "mushy and boring" by a 
numbc" of students. 
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Upcn iiig 

Farm, bov on Hike 



■^ 4;hildrcn on bikes arrive 
at school 
f: n t c r class- J oe y comv s 

over 
Freeze on To mmy 

Fl as^hback - Moving 
^ furniture, *joey helps 

Tommy 6 %Toey playing 

s4 f oQtbal 1 - Man cal 1 s 
lunch 

l,unclt t ab I e sequence 



Hayloft sequence 



Schoolyard § Lunchroom 
sequences, Joey shown 
alone 



Joev at Tommv^s house 
talking out^iiJe door 



Tommy lying on bed with 
- foot bal 1 -Mother comes 
in ^4 they talk 



^ Tommy lyin^ awake day- 
dream i ng 



^ Breakfast-Tommy pushing 
foot around plate 

Tommy on bike, meets 
friends at school 
!3h Classroom, Joey comcsover 
5l rreeze on each chi Id 
find. Closing credits 
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On the tu'o itenij* from the Teacher Questionnaire, 16 
of 17 teachers rated the student interest in the top two 
categories, and 12 of 16 found it better than other school 
television programs. 

Me» Myself, and Maybe ■.• 

The Attention Measures were again high, with noticeable 
dips at points where adults were talking at some length. 
(See figure 4.) 

From the Teacher Questionnaire, of 17 teachers, 13 rated 
student interest in the top two of five categories; 10 of 
15 rated it better than other school television programs. 

The Student Interview materials revealed that students 
frequently were stimulated by the program to the point of 
being quite anxious to participate in classroom discussion 
following its showing. 

Success 

The Attention Measures again were very high, with only 
small dips, evidently at points of extended verbal discussions 
with adults, (See figure S.) These were not viewed as serious 
flaws . 
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^ Open i ng 

^Ballpark* Oeanno misses bull 
i« School rol t*-p lay ing 



Deanne in beJroom pantomiming, 
J mother comes in 



Uinner with Aunt 



^ Deannc § Aunt in car 
School letting out 

^Sewing room^ i>canno enters § 
J opens present -yarn 

^ Aunt cuts dress while Deanne ties 
J knots 

^Dialogue, shot on Deanne^s face 

^ Dialogue ^ Aunt * s face 
TLCut to Deanne^s face 
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More dialogue^ Aunt*s face 
^Deannc unties knots 



Back to school role-playing 



Sewing room with Deanne tying knots 
^ Aunt at sewing maching 



back to school xole-playing 
Deanne volunteers 



Back home at dinner table 

Deanne gives present to Aunt, 

opens present 
End, -"^top action on Deanne 



0|H*n i nj? 



— A i r p 1 a n i - t u k o s c> t" f ; 

man jumps out of airplane 

-Man entering car, driving, talking 



Boy on farm seouencc 
^Driving in car, talking 

Man as schoolchi Id , being teased by 
friends for drawing 

Hand-drawn stills 
-Mailroom job sequence 



-Array sequence-exercise grounds 



Army, sequence- jump practice 



-Driving, talking 
Flashes of past 

» Man enters shop 



..Man in shop, sequence of sewing §r 
talking to customers 



ZHf'nd, clothing credit? 



Seventeen teachers reported on student interest and 
compared the program to others; on both counts, 16 rated 
this program in the top two categories. 
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Third Question: Wimi: Tin: I'tnfCATI ONAL Oft.Tf-CTIVrs MHT BY 

THE TELEVISION PROGRAM ALONE? 



The three major sources of information on this question 
were the Teacher Questionnaire (teachers were asked simply 
to rate the degree to which they felt each objective had 
been achieved), the subjective Expert Judgments, and by 
far the most elaborate technique --the attempt to neasure 
directly changes in the students resulting from program 
viewing. This was done by operationally defining the objec- 
tives in the Student Questionnaires and Student Interviews. 
For example, if the objective was that the student could 
"list an increased number of ways to make money," then post- 
viewing performance was compared to pre-viewing data collected 
elsewhere, and the differences were attributed to the program. 

A generally accurate characterization of the results 
from all five programs, however, is that with few exceptions, 
enumerated below, these objective indices failed to change 
in the hypothesized directions. That is, our most direct 
and behavioral ly-oriented indices yielded evidence that the 
programs almost universally did not achieve the educational 
objectives. One of the reasons was the crudeness of the 
measurement that was possible under the limitations of time 
and budget. But this probably accounts only in part for the 
lack of positive results. A second reason was the reduced 
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emphasis given to the behavioral objectives in the television 
programs thcasclvcr. by the producers and designers of the 
programs. This topic will be discussed in more detail in 
the comments concluding this report. 

Treasure Hunt 

The Student Questionnaire revealed no movement toward 
the educational objectives. In many cases the students 
could perform the objectives adequately before the program, 
leaving little room for possible improvement. 

The Expert Judgment » however, was that the general goals 
of the program, if not the specifically stated objectives, 
were achieved to a satisfactory degree, and that the program 
was a definite success. 

The Teacher Questionnaire asked teachers to indicate on 
a seven-point scale how nearly they felt each of the specific 
objectives had been met. The number of the responding 
tcnchers who registered the achievement in the top two of 
the seven categories is reported below, along with an abbre- 
viated statement of each specific objective. (Complete 
statements of the objectives can be found in Appendix A.) 

1. The student will express a feeling that ho can 
currently earn money. Fifteen of 24 teachers. 
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"DECISIONS, DECISIONS" 



Some responses from the Student Questionnaire: 



Item: Llic i& iult oi decisions, big ont^ and 
imalt on&A\ Hit a& m&nij dtclAlonA a& 
ijou. can tkat tjou have made in tkt last 
^tw days. 

Answers: Not to eat oy breakfast. 

To let a bird go. 

To beat up my brother. 
Item: W/mt I teaxmd ^fiom tht piogfiam. 
Answers: Make your own decision, don't hide from it. 

Some decisions arc hard, some are easy. 

No matter how larec ur how small you arc, 
you have to make decisions. 

I*ra not the only person who has to make 
decisions . 

Don't just go and decide, think about it. 

I learned a problem can't be solved for 
you, you have to solve it. 

Opinions about the best part of the program were 
evenly divided between "Tommy trying to decide" and 
"When Joey and Tommy make friends." 
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2. Tlic student will express or ilemtsnst rat e an increased 
desire to raakc money. Sixteen of 24 teachers. 

3. The student will identify factors which may assist 

a person in finding ways to make money. Fourteen of 24 teachers. 

4. The student will state sacrifices one may h.iv to 
make to earn money. Ten of 24 teachers. 

5. The student will list an increased number of ways 

to luake money for himself or herself, Eleven of 24 teachers. 

People .Need People 

Once again, the Student Questionnaire showed no appro- 
priate improvement (on questions where improvement was 
possible). The F.jcpert Judgment was that the specifically 
worded objectives were, in fact, not very directly addressed 
hy the program. The objectives, and the number of teachers 
who rated achievement in the top two of seven categories, were: 

1. The student will demonstrate an awareness of 
interdependency . Nine of 14 tcacherji. 

2. The student will be aware of the need to compromise 
between independence and dependency. lileven of 14 teachers. 

Pec is ions. Decisions 

No -hanges were detected in the Student Questionnaire 

responses, and few were possible given pre-propram student 

attainment. The lixpert Judgment was that, although the 
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decision-making thesje was very much in evidence in the program, 
there was an emphasis on social decisions rather than on 
career decisions. This was seen as a significant flaw. 
(Changes in the curriculum guide attempt to redirect the 
focus of the classroom activities for this program.) 

The objectives and the teachers' ratings of achievement 
(in the top two categories, only) were: 

1. The student will describe factors in the decision- 
making process. Eleven of 16 teachers. 

2. The student will distinguish between reactive and 
proactive decisions. Five of 15 teachers. (Most teachers 
were not familiar with these terms.) 

3. The student will identify current career-relevant 
decisions. Seven of 14 teachers. 

Me, Myself, and Maybe 

Few meaningful changes were detected in the Student 
Questionnaire data. 

The teachers rated achievement of objectives in the 
following manner: 

1. The student will describe ways in which one acquires 
a self-image. Nine of 13 teachers. 

2. The student will describe self-clarification through 
risk-taking. Nine of 13 teachers. 
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3. The iituJent will draw sclf-othor parallels. Eight 
of 12 teachers. 

4. The student will identify ways to test assuiaptions 
about Himself or herself. Nine of 13 teachers. 

Success 

The Teacher Questionnaire showed the following ratings 
of achievement of objectives: 

1. The student will give exaiaples of successful indi- 
viduals and criteria of success. Ten of 15 teachers. 

2. The student will give self-appropriate criteria of 
success. Ten of 16 teachers. 

3. The student will give an example of self-defined 
success, which might not be success in the eyes of others. 
Nine of IS teachers. 

4. The studeni: will give an example of success in the 
eyes of others which was not success to the student himself 
(or herself). Nine of 15 teachers. 
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Fourth Question: WERE THE EDUCATIONAL OBJECTIVES MET BY THE 

TELEVISION PROGRAM PLUS TJIE CLASSROOM 
ACTIVITIES? 

A number of the programs were iesigned in such a way 
that, if the educational goals were to be obtained, the 
burden would be on the teachers^ activitifes following the 
program. The immediate post -viewing activity was usually 
a discussion focusing on the career development concepts 
presented in the program* However, the results of the present 
analysis once again indicate that, in general, no changes 
in student performance could be detected by means of the 
questionnaires administered after 15 minutes of discussion* 
This result evidently is attributable to a number of causes, 
or a combination of causes^ including: 1) poorly cali- 
brated measuring instruments, 2) inappropriate teacher 
activities (perhaps through lack of preparation, for a 
variety of reasons), and 3) the short time limit (15 minutes), 
which may not have been sufficient for any real changes 
to occur* 

In fact, the actual raw data did indicate a number of 
changes had occurred, but they often as not were in directions 
other than those hypothesized, and not large in any case. 
The overall picture suggested that it would be inappropriate 
for the evaluation to invest any of these particular changes 
with significance and interpretat ion • 
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"ME, MYSELF, AND MAYBE" 



Some responses from the Student Questionnaire: 

Item: tilkat I ZeaAnerf iKom the. pfuogfiam, * *\ 

Answers: Taking chances and having confidence in 
yourself is better than hating yourself. 

Just because you are colored doesn't mean 
you are any different from soae white person. 

Don't knock it, you haven't tried iti 

The most popular response was some formi of "Don*t 

be afraid (or scared) to try things," or *'you can do 

it if you try." 

Item: Who do yoa. admifLt tfee mo&t? ThJ.^ can fee 
a ia.mou6 ptxson, a fizlatisfe., on d ^4xend. 
Can t/au think oi Aome wcLtfh you a/te tlkt 
that pzfLion? 

Answers: Abe Lincoln. (X am) honest, helpful, mind 
my elders, (and) I'm against slavery. 

Opinions about the best part of the program 
centered on DeAnne's learning to raise her hand and 
volunteer before the class. 
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CHAPTER VI. CONCLUSIONS ABOUT EACH OF THE PROGRAMS 



Treasure Hunt 

The Teacher Questionnaire included the item, "Would 
you use this program again, in a unit on career development?" 
For "Treasure Hunt," 21 teachers said "yes," two said "don't 
know," and two said "no." (These two teachers would not 
use it because they thought its setting inappropriate for 
their inner-city students.) 

The Expert Judgment was that the program was perhaps 
the best of the six reviewed in that it was interesting to 
the students, demonstrated many of the points intended by 
the objectives, and would serve as an excellent affective 
St iroulus « 

The Attention Measures consistently showed this program 
uniquely capable of holding children's interest for its 
entire length. It was the highest-rated program on the 
attention instrument. 




Thirteen of 15 teachers said they would use the program, 
two said "don^t know." The Expert Judgment was that the theme 
was repetitive and less complex than could have been communi- 
cated by the IS-minute program, but that it did succeed in 
its cognitive, straightforward, and modest alms. 

Decisions, Decisions 

Sixteen of 17 teachers would use it; one said "don't 
know." The Experts felt that the program was very stimulating, 
but that the dec ision -making context was social rather than 
career oriented, and that this was unfortunate; the children 
found the program very stimulating. Evaluation data suggested 
that more visual stimulation be provided during Mother's 
talk with Tommy, a change that was made in the final version 
of the program. 

Me, Myself, and Maybe 

Fourteen of 17 teachers reported they would use it, two 
said "don't know," and one said "no." During two of three 

intervals of extended adult dialogue, viewer attention 

bcgans to flag but quickly revived to acceptable levels. 
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Success 



All 17 of the teachers participating reported that they 
would use this program. From data supplied by the evaluation, 
two changes were recommended and made in the final version 
(i.e. consistent name tags and clarification of store ownership). 
In spite of a great deal of adult-oriented activity, attention 
levels remained high and the theme was communicated. 
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SUCCESS STORY" 



Some responses from the Student Questionnair»e: 
Item: Think j.boat a. time, tfou ufe^te &ac,ct6A^u,l 



at &ome.tklng* How did yoa knoui you wtfie 



Answers: [An example of passive achievenent] When 



the clubhouse didn't fall out of the tree. 
You can tell inside, you feel good. 
When what 1 did worked. 



Item: fUkat dots 4ucce44 mtan to yout 
Answers: Well, it don't mean hardly anything to me. 



Money, fame, and women [from a fifth grader]. 
A winner! at home, school, and play. 
Success means perfect. 

Success means doing your job, whether you 
like it or not, and get it done right. 



Most popular responses defining success included 
some form of "doing something right," "being good at 
something," or "doing what I want to do." 
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CHAPTER VII. EVALUATION SUMMARY STATEMENT 



Of the five (out of six) programs that survived the 
"work print" or preliminary version, four were seen to have 
particular flaws that were serious enough to require correc- 
tion. The bedroom scene in Decisions, Decisions and the 
name tag and shop ownership problems of Success subsequently 
were redone, but no evaluations of the altered versions have 
been completed. 

Technical problems, especially in the sound tracks of 
"Treasure Hunt" and "Me, Myself, and Maybe," resulted in loss 
of comprehension for some students and teachers. These 
problems were thought serious enough to require new sound 
tracks for some portions of the programs. 

There is no question that the overall impact of these 
five programs is quite positive, i£ their purpose is agreed 
to be that of an affective stimulus for fourth, fifth, and 
sixth grade children. (The programs involve children, excite 
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them, and stimulate discussion both in and out of class.) 
Providing an aff ective stimulu s is in contrast to the 
achievement of specific and particular, behaviorally-defined 
educational objectives. Such objectives may serve the needs 
of many career educators, but could be obtained in other^ 
more effecient ways without the use of television. 

These programs are all popular both with students and 
teachers, and although they should not be coi>j$idered a 
complete curriculum package in themselves, they can constitute 
a fundamental and extremely valuable component of a more 
diversified unit on career education. 

An additional overview of the impact of the programs 
can be obtained from the teachers* reactions to some question- 
naire items. (See Appendix B.) 
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CHAPTER VIU. CONCLUSIONS AND COMMENTS 

ON THE EVALUATION PROCESS 



The most rigid and objective of the evaluation techniques 
attempted in this effort, that of student behavior changes 
as measured through questionnaires, generally showed "no 
effect," One of the more interesting findings of this 
study is that, if this were the only source of data for 
the evaluation, the project would be declared virtually 
without impact. Yet the data collected from other sources 
and by other techniques indicated successful achievement of 
what was intended, and generally a high degree of satisfaction, 
on the part of all concerned, with the total product. Clearly 
some discrepancy or misinterpretation was occurring in the 
direction and design of the project, chiefly in the emphasis 
on the educational objectives by the cvaluators, and their 
de-eraphasis by the producers. 

Objectives such as '*the student will state an increased 
number of ways to make money" were taken quite literally by 
the evaluators, who did not consider the goal achieved unless 
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thi> .Sampled stuJtMits diU, In fact, show on increase In their 
ability to list wa>'5 they could make money. [t was clear 
from the final program structures, however, that this specific, 
literal interpretation of the objectives was not the guiding 
force for the production. 

In fact this seemed just as well, on reconsideration of 
the real and reasonable goals that should be set for such 
a project. If the goals had been interpreted literally, 
they could have been achieved rather easily by designing 
a repetitive presentation of lists, for example, of ways 
to make money. (In fact, this might not have been necessary, 
considering the great underestimation of children's abilities 
and knowledge prior to the programs.) 

It was somehow understood implicitly by the production 
team, however, that this was not the function for which 
the television medium was to be, or should be, used. Rather, 
producers' efforts were directed toward creating stimulating 
experiences, such that viewers would find the particular 
topic interesting, be willing or even anxious to talk about 
it afterwards, remember it for some time, and in general 
probably undergo certain affective changes, rather than the 
cognitive changes that were indicated by the educational 
obj ec t ives . 
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This, then, accounts for tho rather odd set of circuia- 
stanccSf in which virtually no achievement of the declared 
objectives could be specifically documented while at the 
same time the programs were being pronounced, with some 
few qualifications, quite successful. It is a confusion that 
can be noted In other evaluation projects and suggests that 
the administrative process of evaluation be modified and 
clarified, in order to gain maximum usefulness from the 
ovaiuation activities. 
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APPENDICES 



A. Ctiectivei: for- the five evaluated bhtad 
6 butt6%ii television units. 

B. T>ome tfachcrs* reactions. 

C. Attention measures. 

D. Evaluation instruments for a representative 
prop,ram: Succef;s Story. 
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APPENDIX A 



Objectives for the Five Evaluated 
btcad S baftei^fici Television Units 



A;-; pdr t of tht^ curriculum development process for 
btcad S buttc^ii^ieh, members of the design team, in con- 
junct ic^n with the evaluation team, developed objectives 
for the toleviGion components of the project. 

The tolc»vlr-ion unit is only part of this career 
development proieot. This unit is seen as the television 
or film pfor.ram .mi the clat'sroom activities immediately 
precodinr and immediately following its presentation, 
r.v'-.t -vlt^winr ..k, t iv it ie?> taking more than 15 - 20 minutes . 
are not p it^t of the television unit , even if they are 
des tinned to follow the prorr^n immediately. 

The '""/.^I uat joii of the five programs discussed in 
thi.-. r'opvir't Hi ti".fi, in part, on these objectives. 




nilLF-INlif rrNI t'Nn' ANI^ TI;K KOONOMTC system (Treasure Hunt) 



lute: !r;t'slivite youth at e seiaking ways to demonstrate 
gr'« itt"'r- ;t:.i*'jH!ruiiMiot' and initiative. This can be expressed 
[y ill 'wini' 'h. youth to participate in income producing, 
.^f t I V i t If .i .^f Ljiti h<Mno, f.chool and neighborhood. In our 
3.-^'^ tv, an individual's freedom, his psychological percep- 
tion as well ar, oth«r perceptions ot himself are 
.•♦t♦^•i c I by his ability to participate in our economic 

. A . tru^ -r"nv i ?'oti::!ont ot work has shif ted from, th^ home, 
r . ' di: jro .i.Miit;d an opportunity to observe the economic 
..Vv t.r'!. r thi.4 n ason it is important that youth be allowed 
t j .1.. L an i t Ap«'! lonoe the pi^ocess of producing a product 
Aui^.i pr-vidirif i ^t ivico that can be sold at pxxjfit. The 

.. ML.-ht in.:Iudt ^-niny through the several stages of 
^r/.r . ■ .. ! t,r i ooi:.;.inv, ^'btai^un?, capital » sclectinp, a name, 

V.., . btalnlru- a charter, adopting by-laws. 
Of i! : .-ii-.i' r jioduction, assigning responsibilities, salary 

! . : , <>li:iiirin/ 1 matt^rials, pricing product and/or 
»**jv:.- , t'U'. r .1 lH....ir'd ot dir^^otors, open a bank account, 
e. ••'<:.! '1 J : r ^..l'. t i' T! linft, move company Into production, 
i!:a!-K. ! ia^'. '■ • e p'. . Youth can have their horizons expanded 

in t.,ir : !, L»- ; . ' --|M<? and authentic options they have to 
i-aj't i c I .1 • In ^ Kt- t;;( :onomlc tjystem. 



« , y , 

i\p^t: * J.e* fio. ei:.s nr^ducing income and discover 
■.; »"s 'a the studtsnt can achieve economic independence 

!v ^ a: 1 1 i I 3t in^', in the economic system now and in the future. 

C'hjf' • I ves to r t l.o Television Unit: 

C.'.v w t f in£ title foT' the television unit is "Treasure 
At*^^' viewing' the t<iievision program unit, the student 

wi , ; : 

I. ixprs^ a fti..-liin; that he can currently earn money. 
iKpi- • ien.oniit rate an incr-eased desire to make 



3. U.-'iUily factors or conditions which may assir.t 
t.ht' Inlividual in tiP'Unr, w.^vs h*? can make money (e.g., 
iviN^rfU;: Inp, neo it: v't people tor a product or service, under- 
standing ono*. abilities, demonstrating responsibility* having 
fr.ont'y I'.iker. money, etc.). 

Will list nr state sacrifices one may have to make 
. yo o..irn money (e.f.., lusj^ of lor.ing all money, delay in 
tv'Vard or' .r-et-urn, return to f,aine stage of no profit, inter- 
port' on. il ptvsMeir.;; with otheru, etc.). 

b, Lir>t an Incrt'-ined number of ways in which he 
p'T uHi.il ly may mako money. 



rNTi;F!)i:ni:filu,N' r >i W.'?-'KI:H;> (People Net-d IVople) 



Pat iort 1 1»- : 

• Piv" uioi v.;o*>nt:5 display boundless energy coupled with 
inten-.e vit-'Irc tv5 nake one*t; own decisions. Children 
Winr to be abi-; to .lemons trato their own independence while 
cit the i3.iine tin:..- i in«i a high desjree of acceptance with their 
pp^r-. In an attempt to f,ain social, acceptance, the child 
I'virnr. that in ovdo.r to he accepted himself he roust also be 
wlilinf, to p.vdiit aCvJfc-ptance to others, 

r>tudontj4 at thi:> a^^e n»2ed (a> to view examples of 
do-, fi.ioncy ifid into: dep.=»:iuency of individuals in the world 
of work thciL will provide models to follow in building more 
oooj'orat ivt^ liaison with others; (b) to recognize social 
cv,ntrLbutLun.«3 ot eacli job to the total functioning of man 
an.l jocicty; (c) to ^^din respect for the contribution of each 
mcmbor ol tho t»an., not just for production, but for meetinp. 
each other htinum needs; and (d) to recognize that different 
work tiitudtlon.5 meet varying levels of social and psychological 
needs. Instructional activities in the program will stress 
an interdependent, intti-act ive learning process. 



' »o il ; 

To fvic'iliiatr' The .stu<it:nt's understanding of how workers 
^r*- ' It^.t: !!■ it nt. up -; •- a :h other to meet their physical, social, 
an 1 p,'v/cholo.t^ Lcai ru.-t !.; .tisd to increase the effectiveness 
^'t their inter;is'pendi>nt re Iritionships with others* . . 



Object ive : f .>f ttie Ti-L.^v Ision Unit ; 

(7iif,' working; title v)f the television unit is "People 
A'loi vifvirif tilc teluvii.,ion program unit, the student 

wUl: 

1. Iv-n- -n;. t rat t an awareness of interdependency which 

a. Thf Undent will state an increased 
nuiTiler ut ways man is dependent upon others 
(<?cc'ntjmic to meet physical needs, socio- 
ii.iychclor.lcal : social reinforcement, compan- 
it>nship, intellectual growth, need for completion 
or clo.'ure , etc . ), 
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h. iUvon a product, the student will identify 
Wvifkt^rs who contributed in an interdependent 

w.iv t. - 1 h<' >'*-'>f^irl*'^ ^'"^^i of that prt:>duct (^ix)duct 
in the film is in thto area of construction). 

Given a ^^roup work «;itiiation, the student 
will choose when to act independently and when 
to depend upon others, describing the appro- 
priateness of his behaviors. 

ti. The student will select a number of workers 
for whom there is a mutual dependency of worker 
relationships, describing the naturae of those 
relationships. 

e. The student will select one worker upon 
whom he is dependent and who in turn is depend- 
ent upon him, describing the ways they are 
interdependent . 

2, Demonstrate an awareness that in many work situations, 
the in<iivldudl will h-we to choose from among his independency 
anJ dependency needs, with consequent compromise. 
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DrcISION MAKirJ;; (De.'isions, Decisions) 



Intermodidte youth need to understand how to develop 

vVoIri ion making uki lit; 4nd the opportunity to apply decision 
fuH?' t'.ig -4 111", daily. 'Vhe.y ne&d to rocognize and experience 
tUf-^ .. urvoi thit tlu^y can exert ovor their lives when they 
<4rr-i-7 a T'ation tl fiippr-^A>:!i to decision making. Therefore, 
V- :tn >.t till:; aft* av^ rt?ady to explore the factors that in- 
ti i *?i.-*» t}i-^?Ir i<^cisiw^n-i and the fact that they are responsible 
f'T Mie uut.->;\Ties of tlieir decisions. 



Applies deciniva makiiig process in selecting and ex- 
plainlfir a nunib<'r of- hypothetical options and discovers 
f iv ! .-rs th.it influence decisions and possible present and 
lutur-* consevquence;* of given decisions. 



.■t.ject i ves for the Television Unit : 

After virvnng the. television program unit, the student 

wi i 1 : 

1. Dor.crlbe cine or more factors in the decision making 

process?, liucJi as: 

a. f/athering more information 

t>. considering consequences of both alter- 
am tivfo 

c!. considering how the alternatives relate 
to values, etc, 

2. ^ liven yevorvjl situations in which decisions are 
mddtj , ilstinguish between proactive and reactive approaches 
used, 

3. Identify one or more current decisions in his life 

that hav*^ career relevance. 



:n:Lr-^LARirTCATION -.^U*, Kvr..'lf, and ?*ayb«>) 



'.'hi ldrfm 2t fhi.'ze if^es have the capacity to compare themselves - 
with -iul 'iif fer^nt i ifr themselves from significant others in 
t'T'T," I hit r n , i'ioas, beliefs, abilities, likes and dislikes. 
Crip i! :]\* i^;-, »i, : Ills, Because children have a wide range 
of intore .t at thon*^^ agt^s, it is important to provide a broad 
rriHi'^*^ w! expfi it^nc which enable them to expand their clarifi- 
c.i^ic^n f sfi 1 ! i'^.A ♦o develop positive self images, 

"hi]'!r€''i of ^htT.** a^^es are moving from a stage of initial 
sel t- 2 ron^-^ns to one of crystal ising an independent self-concept . 
Thi-" it;* r Kluot i on o*-' differing cultures and life styles of a wide 
P^p.-., ,.f Hi'ilti> if, esf,tintial to that process. To extend the 
.-['1 ir r. f r i. lent i 1 icdt ion beyond the perimeters of the school 
y;<,ciorv rfv^ s th** chilli a more realistic range of epo-ideals 
from wl:ii;h lo choost^. " 



Tc inor«^driH clarificatiorj and acceptance of himself, his 
'ini.vHTif'j's -ind ht^havlor, and his evolving self and aspirations 
vnthin rh- larrer zociefv* 



't^ct r /ef; for tho Television Unit: 



(The workinr; titl*» r.f the tf»levision unit is "The Bead Necklace 
After viowins?, the tf-levision program unit, the student 

1. Describe twc' or morf ways in which one acquires self 
riwarpnt?ns or' verifies a self image (e.g., experiences, associations 
with others and the fee<1h>ack given, reading etc.). 

?. "ivf? an example of how self-clarification and/or a 
positive feeling about self may come as a result of taking a risk, 

s . Draw a parallel between a self characteristic and an 
ability, interest, value, or attitude of another person. 

a. Identify at lease one way he might reality test an 
assumption about himself. 




WHAT l'r> SUDCFSS? (Success Story) 



-iHiilHiiiili. 

Chil Iron, i1urit5>^, the intf rni^uiiate years, express a heightened 
fiefjire for rfK'O^^ni t ion : they are concerned about, and affected 
by, their successes and failures. As they explore their ideas 
about success, they need to experience and recognize: (1) the 
fact thfit success oftt^n stems from meeting social, economic, and 
psychological needs i C?) the variety of ways by which success 
may he achieved; (3) that their success is often dependent upon 
ojitabl i'jhlng cooperative working relationships with others; 
<u) how their needs may differ from others, thus , affecting personal 
criteria for success; (5) factors that make for success at work 
such aii a sense of achievement, recognition, work itself, respon- 
sibility, etc. 5 and (6> the difference between internal and 
>ixfernal factors that affect their emerging definition of success. 



God 1 : 

To explore both internal and external dimensions of success, 
define success for himself and project possible present and future 
implications his definition of success might have in his several 
life roles. 



Objectives for t he T e lev isi on Unit; 

After viewing the tflevinion program unit, the student will: 

1. Cite examples of individuals who may be considered success 
ful in different ways and give several criteria which distinguish 
their success. 

?, Cive several criteria of success which he considers 
appropriate for himself at this time of his life, 

.1. Oive an example of when one may be successful, though 
not considered so in the eyes of others. 

u. describe an experience where he was considered successful 
in the eyes of others, hut not in his own eyes; report why and 
how he folt. 




APPENDIX B 



SOMK TL'ACHERS* REACTIONS 



Although tho unanalysed raw data obtained from this 
ps'<)}oct are much too voluminous to present in this report, a 
certdin lack of representativeness is created by summary 
presentations only. A sample of the data, on the other hand, 
Gould be misleading and wide distribution would not be 
appropriate. In an attempt to arrive* at a cojnpromise on 
this issue, one question was selected from the questionnaire 
administered to the classroom teachers, and the complete 
results are presented below. 

Tho -question selected was relatively neutral in tone, 
and was asked as the final question in all five of the evaluated 
programs. Following is the question and the list of responses 
from all teachers who participated: 



"Have you any additional comments on the program «nd 
its utility in your classroom? Please express your opinion 
as fully as possible." 



Tr€'atmre Hunt 

Twenty-five teachers rtJSponded. Eleven had no comments. 
The remainder are presented below. 

"I psfL^onaity think that attltudz6 tOM?a/id uAC monty 
hhcutd 6c itmssed. Thetj earned Juht to enjoy; maybe thzit 
(ccic othen vbjectivei ^vk the. mon&y uie.," 

"T enjoyed and appneciated it,** 

•"I tva5 undeK the impie^^ion thii M^a5 a pKogfiam in cafiteA 
education, I ^elt tee much 6tfLQS& m& ptaced on making money,** 




"I tkcu^ht it icouCd be A good vehicle £01 a "valuer" 
discus &ivn peiicd.'* 

"taking mcmy thi^ concept can be uked to Idtntliu 
pupt£i mth ^txcngtlu and u?eafe«eA4C6 in thU akza,** 

"I ttvaerf be vei^ lata\c&te:d In ^^&eing the. atfee* pficgnams 
xeCatad tc this Subject,** 

""Tke A.dta oi inteta^t, ican6. €tc, U ^ocd ion. thtinL 
J-ttfi to fertfw about. VaKtk&fiUg tkU muld dtUnluiu be 
bcne^clai tv them." ° ^ 

"hiofie time coutd be medtd. thpecialli^ yoith a cla^A 
l4.k^ mine that need time, iaxthtfi explaining, QvLe^tionnaifie 
CtU' itimg and bc^uig, Pi&ati6&ion caii&d hasfe been bettet,^ 

"Catiuvdtf backg^vand nvlie mas diAtfiacting , I cauld 
tcitow the Atofty becau&e I had fiead the 6ynop6i&, Ctoie 
upA the ehitd^en talking wem hetpiul in unde^itandina 
how each child icCt." ^ 

"The clahA liked it,** 

"Interesting approach to Valaei,** 

"The pfioaram excellent " it meets the needs oi the 
students the students enjotjcd the. p/ioqiam. We need mote 
ptcgtams like this because it teas fietated dinectla tc the 
students ,** 

little fie emphasis 0n the idea that vje live in a 
uft'i^d 0i H'otfe. To have the things we yeant, m must mn.k 
((cr them. Any honeht {*?c»ife is honoiable*** 

"The pxcgtam leill be uie^ul in that the students need 
guidance in developing and becoming responsible individuals. 
Thii pxpgiam will cefttainlij serve as a needed guide,** 

People Heed People 

Fifteen teachers responded. Six had no comments. The 
romainder are presented below. 



on th 



"Ixcellent I can* t wait to see and work with children 
is se^ies,*' 



"The tsamt^!i'>xk approach in the i^ctbatl 4e^ue«ce uta$ good. 
It can he. eiiectiveiq a^Qd to 4ft<?itf pupiti that winning oK 
ioiin^ a game i& a. xeiutt woftkin^ tirgethei.** 

Aiici, the yeoman lineman segment &hoi/Qed that ii a p€^&on 
l& eapabCe dtyinc^ a ceitain type ci jcb it dotAn t d€;pend 
on i/okethen the veofikex is male on. iemaie. Too, it shositd kos^ 
ait membe*t^ had ttvifc to^ethen, to ciet a $ood job domf 

"These tutii episodes can be He la ted to evefty-ddtf events 
in schoot." 

"I appreciated the poition about the "iine,^ pzfL$on »" 
a teachefL, I am ttijing to efia&e certain atti-tudHA about 
laomi'tt. tie need mc%e cfi thi^l I think thi& pKogfiom could 
be used eliectiveitj in my elati." 

**l ieel that this would be a yefiy mKthiohite pJLogfiam 
Hex boyi and gi%is to viei& on television. I betitve mofie 
dialogue Would add moxe '*colo\" to the pfLOgfLam. This 
pXiigxam is much needed in oux elementaiy schools, Bo*ts and 
ciixls 0^ this a^e level should begin thinking and woKking 
towaxd theix caxeexs." 

"Puc to the iact o^ inteKfiacial gxoaps vietioing this 
se^^es^ 1 do ^eel pexhaps many xaces should be used} 
examplest Japanese, Chinese, etc,"* 

"My class needs this exposuxe to the iact that people, 
need to'coopexate and get along. Quite o^ten at this age 
they don't i^nel as though they need anyone. This is good 
f^xom a human xelatiom standpoint . 

Thexe is a vexy contempoxaxy appxoach and J xeatty tiktd 
it. I know they did." 

"A^tex discussing youx definition of cafieeA development, 
I think this is a gxeat' means of, appXoaching this topic, I 
think it is valuable to have the kids evaluate thzift "fioies** 
in 14.^0 mw and how di^^exent gxoups o£ people help and ne,td 
each 0 tk<x. ** 

"Cvlox makes this pxogxam even more appealing. In ouK 
school we have no cotox monitoxs. It would be intefiesting 
to xun a test gfiL'up with a black-and-white set to set ii tht 
intexest level was as high. I ieel this pxogxam and 6tfiies 
iill a need iox good gxade-level matexials in cafieen. education, 

"Excellently done*. So many possibilities iot in depth 
discus sicnl" 
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Jilevcn t;oa< ht'i rf!i;poiiih a, Mx aaJ no coniments. Tiu* 

"Cud it»Mq ii4 <«f !ii'4uc f . 

to make them (lUnk* Thetj have evsxtjthing dene iv% them 

"f hava talked ii.Uth fwr v>the^ (eachct* ha^e. done 
iX U^t avtfc it'-tt/i vaiuei ctani^lcation md I have become 
vj ttj in taxes ted <h this, atca. Z f/iou^^f mana points o^ 
discuiticn that lecne t\iggsned by thH p^ognam,^ 

'*Ctviettf tedxted t^^ the itadenti^* own expeKience6 * A 
pxcbtetii iiHtj one oi them cuudi be cx hai been con^ionted i^tith 

"I ^eeC that Lfitx itudent^ need opt?o^tuH4tiei ^uch a6 
this ft' t'\f.nt'j4 tkeii jji^cfoia* on non -academic ifubjects 
tach vaiuei and deeiiion making. Thii f^fiogH.am taoutd be 
vatuabie in "itaiting the baH ict'^tHt}" Ion m'aAtj cia66%oom 
diicuiiicni . " 

"I tecutd vextf much enjiftj a &emi-%eguta% U6e ai p*Log%am6 
oj this natuxe. f dif , h^neevex^ hetieve' that the pnognam, 
in itietit tecu^i be venj in^^ i^ective, K good ioitof/o-ap exet 
cihe leeutd be essential in iniuiing that the message i& made 
cleat. Ai'SQ, di^exent appxoaehes and activltieh would have 
to be emptofjed \fh the semi-xegui'ax pxogxam teoutd be ine^ec- 
tive. In essence then I'm saulng that to make thi6 a >teHJa*d 
ing activittj fccf/i students and teachens much be cfieative, 
intexested and ^xee to CL^mmunicate," 



Me, Myself , rfrid M.iytxj 

13evt;nt ft-^n tea^jht't;; re.spondaU . Six held no comments. 
Th»? remiiruior .ifc* y.r* ■s>r:nT od below. 

"I ieilt it pointed I'ut the seC ft'aieax.enes& aspect oi 
cancer educatiL^n, hciccvex, I have mu doubts as to the 
e^f,ectivene s& as a '\*ne - shift" thing. (I xcaiize thcfie axe 
moxe in the sexies, hut axe thetj v'n the &ame toplcf)" 

"I den' t exactdj see iti xetrvance to ca%ee% education', 

"Tlh' man'j points leexe ancCeax duning the teievi&ion 
pxogxam, I think chiidxen shoutd be made amne oi the objec 
fu-"e5 as <5 the iteachexf] 



**I iiked the ude oi a middt^-cia$i minv%lty iamlty 
the main chaiact^t^ oi the pfio^xam. Good ^ot both mlmoKlttf 

iiom the iitm theif can fketate thein imecu^ittf and tack 
ieti-coniidcnce to PeAnne* i 

"J u!outd tike, to have mote thi^ type oi pKogfiam,** 

"Thih pfic0%am is excellent Ia getting the ckitdfttn 
ti' bee themset've.^ a6 having the 6ame ^eam etc, ethefti 
including adult&, ThiA soiil help them tMf thinQA th&if have 
been ai*ta<d to take paxt in, 1 believe the tack seti 
confidence li one o£ the hatde&t tn.aitt to oveicome {pCfL6onat 
eKpe*iience) 

**$intHd cculd be impficved, Thi^ yean the lacial balance 
in mtf loim made thih ptogxam vefiif elective," 

"We have a numben. ci iilm ittip^ and fiecofLd6, but J 
ieei that a movie type^ presentation is mo He neati&tlc*** 

"Hatj be bette\ in a set^-containcd class situation 
whene pn.oblems o^ students in di^^exent axeas {academic 0% 
Si'ciat') iinould be apparent i" 

"BveXij Aiith gxadex should be ataaxd 0^ the positive 

xesutts uihich Qood citizenship aiioxds* In ofiden to be 

a iood citizen, a child must have a healthy seli-concept. 

This pxogxam aids in pxescnting guide lines in thiA tine,** 

"I iett the pxogXam gave oppontunity ^ox stude.nts to 
discuss (luesticns they have had -- and pkoblemsi I do 
believe it depends upon the teachexs intexest, howe.veJL, and 
I can xeadily ^ee negative atmosphcfies raining the posAibitity 
^ox gxo(A}th among the students and theix paxticipatlon, ThcM 
must be a ^txust level" -- ox. thexe can be no discuS6ion*** 



Seventeen teachers responded. Nine had no comments. 
The remainder are presented below. 

"I am looking fox-waxd to seeing a iult synopsis 0^ the 
entixe sheui, not just a single broadcast » 1 £eet that It 
is a vexy u)oH.thu}hile ptogxam one that I ^ce^ will be a 
gxeat teaching aid,** 

**1 think that moxe shows like this mutd beneilt the 
kidSs Uccatlonal planning could begin in Elementax.y school,** 
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Thi^ p^cg%am waA gocd, 1^ it p\e.6tnttd, 1 

t^tan fti u5« it itt mij cia6$%cen. I seems to £ilt a need 
at this timii in a students' schecC tiie.** 

"Tfec pxog^am ms pfmsented in a fie.atiAtlc wanne* so 
that tfte students interests mxe. maintaintd. This qIvzs 
the students a back^fiound f^oK some constfttLCt-ivt th^uaht 
a^texwands." 



"This 
to taek 



is pfLoafiam can fee vcti/ useiul in tfetting students 
about hovii thttj view thein latufie,'^ 

**l ^eei mu students would ens otf the pfLoafiam and benefit 
ixcm xt. Ch<ld%en need tc staxt .eaxttf and plan what theifi 
caxeexs axe tc fee." 

"Good ^ox eux Human Behavicx atso,^ 

"I think that this pxcQXam, i^ used on a xegutax. basis, 
(ivul'd fee a vexu impoxtant teaxning exp&xience iox theix 
^utuxe decisions on ti^e woxk." 
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APPENDIX C 



Attention Measures 



The use of attention measures to examine television pro|rams 
is based on the assumption that if -the audience is not watching, 
it is not learning. This assumption does not mean that what 
is to be gained from the program is necessarily visual and that 
the audio track is superfluous. It does suggest that if students 
in a classroom are not watching the television monitor, they are 
likely to be doing something else. Attention to the screen is 
thus a necessary though not sufficient condition for optimal learning. 

There are several attention measures in use in children's 
television, the roost widely known being Children's television 
Workshop's (Palmer's) distractor method. The bread & butterfliea 
project uses a pair of observers to record sequences of viewing 
and attention patterns. The data from numerous classes ax*e then 
grouped to obtain a program profile of attention for each tenth 
second of program running time. The resulting profile charts often 
can suggest sections of program material that maintain high interest 
levels and those that lose the student viewers. 

Tn the data obtained in th^ bread & butterflies evaluation, 
essentially the same pattern of attention was found across grade 
levels, geographic regions, and socio-economic groups. Use 
of color or black-and-white television sets did appreciably not 
influence the pattern. The data are remarkably consistent for the 
programs in this study. 

The method used to obtain attention data from classrooms is 
further explained by a careful reading of the directions for using 
the Attention Profile Form. 



ATTENTION PROFI LE SYSTEM 



.-■ During this program each team of observers wiXl be checking 
to se« whether selected students are watching the progrora as it 
progresses. To do this, you will need the Attention Profile Form 
(agree in advance who will be Observer #1 and Observer J^2), 
a -pen or pencil, and a watch with a sweep second hand. Before the 
program begins, check the classroom layout. You will probably have 
tQ f ind extra chairs so that there can be two observers* seats in 
the front of the classroom On either side of the television set. 
You will be watching the students while they are watching the 
.program so try for the broadest possible line of sight (including 
students in the back row). 

Each observer will be noting the attention of ten students 
throughout the prM>graffi. Once you have your seat established 9 
each observer should mentally pick out two groups of five students 
to follpw— alternately^-during the program. You will record your 
observations first* of one group, and then of the other. You should 
be able to see each group easily as a single unit. All five faces 
shbuld be visible in a single glance. The students selected for 
each group should not all be in the same row or column of seats. 
Within your two groups, try to include some of those sitting in 
the back of the room. 

Each observer will be making one observation every 20 seconds. 
Observer #1 will begin at 0:00 (and check again at 0:20 and Q:UO, 
etc.). Observer #2 will begin at 0:10 (and check again at 0:30 
and 0:50, etc.). Since you won't be able to see the program as 
the class is seeing it, the audio cues on the Attention Profile 
Form should help to keep you on time. (The first cue "drum beat 
begins" indicates the start of the program opening. ) Listen 
to the dialogue and sound track so that you don't loose your 
place. It is important that the observations be taken quickly 
and accurately. At each observation point look and see if at 
that instant each pair of eyes is directed towards the televTsion 
set. Record your observations in the square (next to the time) 
on the Form. If all five students are watching, write "5"; if 
three are watching, "3." If some members of the group are not 
visible at the instant of observation, record the number of viewers 
over the number of visible students. Thus, means that four 

students were visible, and three of them were watching "Treasure 
Hunt." 

Don't forget to alternate groups : Observer §1 will check 
his group A at 0:0^7 group B at 0:20, group A at 0:40, group B 
at 1:00, etc.? Observer #2 will check his group A at 0:10, 
group B at 0:30, group A at 0:50, group'^at 1:;0, etc. 

One final reminder, it is the watching behavior that you are 
interested in observing. If the students are doubled over laughing 
because of something that happened in the program, they may be 
responding to the television program, but at the instant of obser- 
vation, they may not be watching^ 
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SUCCESS STORY 
ATTENTION PROFILE FORM 

Observer #1 Observer #2 







drum beat begins , !lO 






:2G 




' :30 




airplane motor begins 


; 240 




:50 




plane motor sound changes 


1:00 




1:10 




music begins 


1:20 




1:30 






ls40 




"Df.ei k-' what you want to do" 1:50 




"what it is" 


2:00 




"you got to find" 2:10 




"success for me" 


2:20 




"for us to survive" 2:30 






2:40 




2:50 




"workin'" 


3:00 




3:10 




"Hey, Dave" 


3:20 




"with this wood" 3:30 






3s 40 




"you Jest loaf around here" 3:50 




"man could make Hvln*" 


4:00 




"I found out my father" 4:10 




"you had to be good at sports" 


4:20 




"by myself" • 4:30 




■■■ • • 


4j40 




4:50 




boys yelling 


5:00 




5:10 






5s20 




"we gonna play some football" 5*30 




"Just like everybody else" 


5:40 




"neighborhood". 5:50 




"get into those images" 


6:00 




"people did... but I saw them" 6; 10 




"when I went lookin'" 


6:20 




"my father" 6.3O 






6t40 




"wasn't a hard Job" 6:50 






7 too 




"I'd probably be still workln'^jio 




"three" 


7s20 




"you* re in a good position" 7:30 




"you have the chance 


7:40 




"^irborn^ military police" 7:50 




"telling me what was ^ 



PLEASE TURN OVER 



er|c 



8:00 




8810 






8:20 




"(iif.fVrerit than anything" ' 


8:30 




"around*.." 


8:46 




"something that you had" 


8:50 




"realize that you could be" 


9500 




"firopplng a weight" 


9:10 




"walk a little taller" 


9:20 




9:30 






9: 40 




9:50 






10:00 




10:10 






10:20 




10:30 




"freedom in your mind" 


10:40 




"•all Inward things" 


10:50 




"to the same old life" 


lis 00 




"changes that I had gone" 


11:10 




"that I didn't have to" 


11:20 




"I'd been drawing all my" 


11:30 




"cause this change" 


ll:4o 




"decided to be the actor" 


11:50 




"my own life" 


12:00 




"I cut, I sew, and I do" 


12:10 




"independence 


12:20 




"the prestige thing" 


12:30 




"my whole fate" 


12j4p 




"beautiful, beautiful" 


12:50 






13:00 




"yea..." 


13:10 




"stand back and let" 


13520 




"ya know*.." 


13:30 






13:40 




13:50 




"because you'll feel it" 


14:00 




"crossed the goal line" 


14:10 




music stop 
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APPENDIX D* 



Evaluation Instruments From a Representative 
bfLcad $ butte.n.£ti^& Program Evaluation 



Rather than include all forms use^l in the evaluation's 
data collection process (a redundant and perhaps meaningless 
exercise), evaluation forms from one prograjn were selected 
as representative of the materials and processes used for 
each of the five programs. 

"Success Story" was the program chosen; the set of 
materials included here were used in 18 classrooms with 
more than 400 children. These materials include: 

a. a cover letter to participating classroom 
teachers; 

b. a non-duplicative set of evaluation mate- 
rials for the two post-viewing evaluation 
conditions and the one pre-viewing condition. 



* With the exception of the Attention Instrument , 
the materials in thi^ appendix are Copyright © by 
Educational Testing Service. All" rights reserved. 
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Dear. Teacher: 



National Instructional Television (NIT) Is developing a 
new series of lessens for classroom use with nine -to -twelve 
year olcis. The series is on career development and has a 
television component for students as well as written materials 
for teachers. The series is called "bread & butterflies and 
deals with career development concepts that will help children 
in their future career choices. The enclosed brochure will 
five you some idea of the approach this series takes* 

The first few programs in the series are now ready for 
evaluation. Your state and local education and television 
a£:en''ies have becm active in the developinent and financial 
support of this project. They have also agreed to partici- 
pate in the evaluation. The evaluation process is being 
developed by Educational Testing Service in Princeton, Sew 
Jersey, and the activities are being conducted under their 
direction. We need your assistance to provide a natural 
classroom netting for the evaluation. 

Your local agency will be in contact with you to set 
up a time when we could come into your classroom. We would 
like to show the program and follow it with questionnaires , 
*^nd interviews. The entire process should not take more 
than 4t5 minutes. After reading: the enclosed Teacher *s Guide, 
you may want to do other things relating to the program 
after we have deiparted. 

There will be two observers in your classroom during and 
after the program. Their role will be to show the progratm, 
observe the students during the presentation, and ask them , 
to complete a -iuestionnal re after it is over. A few students 
will be asked, instead, to go to a different room for a 
group interview. 
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J "4 ^^^^ S8lt you to fill out two brief 
.luestionnairea! one asks for your reaction to the program 
t^^l^hl}^^ *° Teacher's Guide. If the evalua tors 

"ith"r'onMS''auLe''S^"'^f.^" '"^'^'S^*^ follcw-up''L|:in"(based 

rf^,,,^,''!;?'"!^"'"-'"" y"""" eiva you more specif le 

studo, ?.- f1n^^h^°r'^?^ eyaluatlon. We hopi you your 
estlnf experience."''''''"'"^" °' ^'^^^ ^ i"*^'-. 



Sincerely, 



Saul Rockman 

Director of Evaluation 

"bread & butterflies" 
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PACKET A* 
(post-viewing administration) 



This packet is to be used primarily after the television 
program has been showh. The post-viewing instruments should 
l?e administered after the teacher has had up to 15-20 minutes 
of follow-up discussion or activity. 



This packet contains: 



* 1 Observer *s Class Profile <green) . . . 
2 Attention Profile System (pink). . . . ♦ 

* 2 Attention Profile Forms (pink) « « . « . 

* 1 Instructions for End-of-^ Program Interview/ 

Interviewer's Questionnaire (yellow) • • 

* 1 End-of-Program Interview Form (EOPSI). . 
1 Instructions for End-of-Program 

Questionnaires (EOPQ) (blue) ...... 

*30 End-of-Program Questionnaii^s (white). - 

* t Post-'Viewing Activity Form (green) . . 

* 1 Teacher's Questionnaire (white). .... 

* 1 Teacher's Guide Teacher Evaluation (blue) 



pp. 91 
pp. 93 
pp# 95 

pp. 97 
pp. 99 

pp.101 
pp.103 
pp.105 
pp.107 
pp.109 



* Please Return * Pieces to: 

Saul Rockman 

NIT 

Box A 

Bloomington, Indiana U7401 



*Post- Viewing Activity Form was not included in Packet B. 
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PACKET B 
(post-viewing administration) 



This packet is to be used primarily after the television 
program has been shown. The post** viewing instruments should 
be used without the teacher having any follow-up activity or 
discussion in the classroom. 

This packet contains: 

* 1 Observer's Class Profile (green) pp. 91 

2 Attention Profile System (pink) * pp. 93 

* 2 Attention Profile Forms (pink) . . ♦ ♦ PP* 

* 1 Instructions for End-of -Program Interview/ 

Interviewer's Questionnaire (yellow) . . * pp. 97 

* 1 End-of -Program Interview Form (EOPSI). . . pp. 99 
1 Instructions for End-of -Program Question 

Questionnaire (EOPQ) (blue) . ...... pp.101 

*30 End-of -Program Questionnaires (white). . . pp.103 

* 1 Teacher's Questionniare (white). . • • • • pp.107 

* 1 Teacher's Guide Teacher Evaluation (blue), pp.109 



* Please Return * Pieces to: 
Saul Rockman 
NIT 
Box A 

Bloomington, Indiana ^7U01 
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teacher's naae ■ 

^ teacher* s sex: i or r 
^t5^ grade level 

^^4^ OBSEBVER'S CtASS PROFILE 



Total number of students In class; . Please complete the 

student population chart below* 

M F* 

BlacH . , . 

• ■■ ■■ . -White ' 

AtMrlc an Indian 

Oriental ■ ■ ■ , ■ 

Spanish Surname 

Other 



The general socio-economic background of the class is: (check one) 

lower class middle class upper-middle class 

lower-middle class upper class 

The overall mental ability of the students is: (check one) 

retarded average ability above average ability 

low ability gifted 

The school* s community is: (check one) 

rural suburban 

urban/inner city urban (other than inner city) 

othe r 

The classroom setting is: (check one) 

self-contained classroom open pod 

team teaching other 



The teacher's experience with career development is? (check one) 

developed materials in career development 

taught specific career development program 

read quite a bit about career development 

had some exposure to career development 

had no exposure to career development 



(PLEASE TURN) 



7. Hew lorv, ^iA it take the class as a whole to settle down and 
watch ^itt^ntively? 



0. mln. 1 min. 2 siin. 3 ffiii^> ^ mn, 5> or.mre 

min. 

6. About what percentaf,e of the class was continually attentive 
to the prpf,rain*? 

0% 10% 20% 30^^ 40^1; ^0% 60% 70% 80% 90% 100% 

9. How many times did the teacher have to re-establish order with 
one or more students during the program? 

0 1 2 3 ^ 5 or more 
10* Whfit. part: of the program ref*eived the least amount of attention? 



11. During the program was the amount of talking, not related to 
the program: (check one) 

a great deal a little almost non-existent 



12. Did the students react to the humorous scenes by laughing at 
the appropriate places, or wSs the laughter sporadic and 
in unusual places? Are there any unintentionally funny scenes? 



13. Please use the remaining jpace to comment on the behavior of 
the class during the te In /.is ion program. 
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ATTEimON PHOFILE SYSTBN fttS^ 



Dufltif thif; ppoffram t^ch team of obscrvera will be checking 
to see whether selected students are watv-hlng the program aa it 
profresses. To do this, you will need the Attention Profile Form 
(afrree in advan*.'e who will be Observer #1 and Observer #2), 
a pen or pencil, and a watch with a sweep second hand. Before the 
program begins, cht?ck the classroom layout. You will probably have 
to find extra chairs so that there can be two observer's* seats in 
the front of the classrooiiR nn either side of the television set. 
You. will be watching the students while they are watching the 
program so try for the broadest possible line of sight (InclUdinff 
students in the back row). . ' " 

Each observer will be noting the attention of ten students 
throughout the program. Once you have your seat established, 
each observer should mentally pick out two groups of fiv^ students 
to fellow—alternately— during the program. You will record your 
observations first of one group, and then of the other. You should 
be^a^le to see each group easily as a single unit* All five faces 
should be visible in a single glance. The students selected for 
each group should not all be in the same row or column of seats. 
Within your two groups, try to include some of those sitting in 
the back of the room. 

Each observer will be making one observation every 20 seconds. 
Observer # 1 will begin at 0:00 (and check again at Os20 and 0:40, 
etc.). Observer # 2 will begin at 0:10 (and check agdln at Os30 
and 0:50, etc.). Since you won't be able to see the program as 
the class is seeing it, the audio cues on the Attention Profile 
Form should help to keep you on time, (The first cue **drum beat 
begins" indicates the start of the program opening.) Listen 
to the dialogue and sound track so that you don't loose your 
place. It is important that the observations be taken quickly 
and accurately. At each observation point look and see if at 
that instant each pair of eyes is directed towards the television 
set. itecord your observations In the square (next to the time) 
on the Form. If all five students are watching, write if 
three are watching, , If some members of the group are not 
visible at the instant of observation, record the number of viewers 
over the number of visible students. Thus, means that four 

students were visible, and three of them were watching ^^Treasure 
Hunt''. 

Don't forget to alternate groups ; Observer # 1 will check 
his group A at 0:0tr7 group B at 0:20, group A at 0:40, group B 
at 1:00, etc. I Observer # 2 will check his group A at 0:10, 
group B at 0:30, group A at 0:50, group Tat 1:10, etc. 

One final reminder, it is the watching behavior that you are 
interested in observing. If the students are doubled over laughing 
because of something that happened in the program, they may be 
responding to the television program, but at the instant of obser- 
vation, they may not be watching. 
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"ME, MYSCLF, AHD MAYBE" 
ATTENTION PROrilE fOm 



Observer # I 



Observer § 2 



iOQ 




drum beat begi ns 


:JOj 






1 20 




:30i 




:;40 




"laugh at you" 


:50 




♦•scream at you** 


.1:00 




It 10 




"role p lay! ng" 


1 .20 




J: 30 




. ^ 


' 1 :40 




*»be next?" 


1:50 




"01 ane, now 


2:00 




2{i0 






2 J 20 




**not us in* a pay phone** 


2:30 






- 2:40 




"any minute" 


2:50 




"all this trouble" 






"cook Mke this" 


3: 10 






^ 3 J 20 




3:30 




"get to entertain them" 


3:40 




"skt 1 Is too" 


3:50 




"It's OK** 


4:00 




4:10 






4:20 




"help me with the map" 


4:30 




"get the knack** 


4:40 




4:50 






5:00 




"4550" 


5s 10 






5:20 




5:30 




"Where you goln* 


5:40 




"come In here" 


5:50 






6:00 




6s 10 




"tie knots to make** 


6:20 




"1 know what you can do" 


6:30 






6:40 




"a ffttio loose" 


6:50 






7:00 




7;I0 




"J don»t know" 


7:20 




"what you 1 Ike to do" 


7:30 






7:40 




7:50 




"easier when" 


8:00 




"three times as dressy" 


6: to 




''lau^h at you?" 



PLEASE TURN OVER 
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♦♦why not?" 


8 : 30 




8:40 


- 


8s50 








■ ■ ■ ■ - '^sia''''' 








9:30 


•'put your hatid up^ 






^'foedffig the animals** 


9:50 


^put youf* hand up- 


lUrjOO 




10:10 




1 0:20 




"didn't matter" , 


10:30 


sewi ng machl ns stops 






10:50 


•'a wnof# ouncn ■ 


i t * AA 




"or a d J sc jockey" 


tl:10 




- 1 t • 7n 

f r • 




"every time 1 do something" 


1 Is30 




11 :40 




11:50 


^eoui4 yoy teach m© howt^ 


12:00 




12:10 


"Oavid" 


, 12:20 






12:30 


"Diane's hand Is up** 


12:40 






12:50 




13:00 




"very good 


13:10 


lot of fun** 


(3:20 




13:30 




13:40 




13i50 




14:00 




"1 can»t tako this" 


14: 10 


cymbal ends program 



ERIC 
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After the Interview, please coaq^lete the questionnaire on other isidev 

EYAtUATORS* TNSTROCTIOKS FOR 
Elll)iOP-PR0GRAM ST Ji}E»T INTERVIEW ^^(^^ 

Aaong the things to accoB^jlish daring the first few minutes in the clas^r 

room, prior to the onset of the program Is to select three (3) or four 
? (4) students to be Interveiwed* Obtain the name of every seventh student 
>. on the teacher's rolebook, if the child is present. If absent, continue 

to the next seventh child. Return bacK to the beginning of the rolebook 
: until three or four students are obtained (i.e., in a class of 25, select 

numbers 7, l4, 21, 3, 10, etc. until three or four stui3ents present are 
\j8€lectedV* ■ ■ 

After the program, or after the post-viewing discussion, request the 
selected students to follow you to a predetermined interview area — 
1 a separate room, if possible^ 

Introduce yourself to the students "If they have not met you before. 

Tell the students that you are there td find out what they kftow and 
how tbey feel about certain things. Explain to them that the people 
who made the program are interested in what they think of the program 
and if they learned anything from it. 

Assure the students that the interview is not like a test and therefore 
there are no right or wrong answers to the questions. Tell them that 
they will receive no grade for their answers. Explain to them that 
their names will not be associated with what they say, 30 that they can 
be more free to give whatever answer they feel Is the best one. 

When interviewing the students, use the interview form as a guide. 
Strict adherence to the wording of the questions is not required. 

. When students have difficulty in responding, It is appropriate to probe 
' using questions that will help them to formulate responses, however 
this does not mean that you are to glye them answers to the questions 
80 that they will agree or d is agre e w 1 1 h'"TEe options you have provided . 

, You will be Interviewing several students at a time. You will have 
to use your judgment in writing down a consensus of the responses as 
well as any unusual individual responses. Try to capture as many of 
students* own phrases as possible. 

, After all questions have been answered, offer to respond to any questions 
the students might have about the program, the follow-up or the evalua- 
tion. Please make note of the questions asked and please be hones v in 
your responses. 

, Return the students to the classroom, thanking them for their cooperation. 




-97- 

(PIEASE TURN) 



1. Did the responses obtained during the Interview com priaariiy froas 

/7 one student; 
^ two of the students 
^ »11 but one of the i»tudents 



Coisients; 



spread fairly evenly aaong the students 



2, ik>« accurately did you record the students words? 

paraphrase 1 2 3 4 5 6 7 8 9 10 exact words 
CoBBsents: 



3. How much (5^) of what was said were you able to record? 

0% 1056 aojg 30^ 40?g 50jg 60^ 7056 805^ 90^^ 10051 
Cbmaents: 



4. Please iK>te any additional inforffiatlon or observations of the 
students which would help in analysing your interview data: 



3, What questions did the students ask you? 



6, Have you any cosmients on the interview in general which wo&ld help 
in analyzing the interview data? 
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SOOJESS END-OP-PROGRAM STROCIWRED INTER7IS*f 
X « What was the name of the man in the pcogiram? (Record alt 



2. Khat did success mean to the nan in the program? 



3. What does success man to you? 



4. Do you know what the sign on the leather shop said? (If 

no ansvfer, prompt for or supply ^The Cow*s Outaidea* " Reoord 
if you aupplted the answer,} imat does this (It) nean? 



5 . When the man in the program went into the leather shop, v^ec 
did you think would happen? What was he doing there? CPrompt 
to dtaoover if the atudenta knew he owned the atore»} 
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EOPSI 



6. Do you kilow anybody Wtio feels successful, even though other 
imbple dpnit thltUc he is? Tell me about him or her. 



7* Tell Bie about a tisie %d>eo you wete successful at sosiething. 
How did you know you were successful? 



Have you ever done soinething and everyone told you that 
you were successful^ but you didn't think so? Tell «e 
about it. (Probe.) Why did you feel you weren't success 
ful? How did you feel about it? 



Finish each sentence; 

9. The best part of the program is: 



10. The worst parts of the program are: 



11 ► The parts of the program I would change arej 
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EOPSX 



SUCCESS END-0F-Pi«3GRA« STRlKOTRED JNtERVt^ 

1, What was the name of the man in the program? (Reoord all 
anowsj^s including di8a0Peement»») 



. tfhat did success mean to the man in the program? 



3. Wiat does success mean to you? 



4 « Do you know what the sign on the leather shop said? ( If 

no answer, prompt for or supply '*The Cow* b Outaides," Rsoord 
if you supplied the answer,) What does this (it) mean? 



5. When the man in the program went into the leather shop, idiat 
did you think would happen? What was he doing there? (Prompt 
to diaoover if the students knew he owned the store,) 
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(PLEASE wmi 



BOPSX 



$. Do you know anybody who feels successful, even though other 
{>0ople don*t thliik I\e is? tell me about him or her. 



7. Tell me about a time when you were successful at something. 
How dicl you Know you were successful? 



d. Rave you ever done something and everyone told you that 
you were successful, but you didn't think so? Tell me 
about it. (Pvabn.) Why did you feel you weren't success- 
ful? Row did you feel about it? 



Finish each sentence: 

9. The best part of the program isj 



10. The worst parts of the program ares 



11. The parts of the program I would change are* 



EOPSI 
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EVALUATORS V I NS.TRUCTI0N3 
■ FOR;- ■ 



END-OP-PROGRAM QUESTIONNAIRE (EOPQ) 



1. Introduce yourself to the students if -they have not fliet you before* 

2. TeXl the students that you are there to find out what they know 
and how they feel about certain things; 

3. Assure the students that the questionnaire is not a test and 
that there are no right or wrong answers to the questionsw Tell 
them that they will receive no grades on the questionnaire. 

Instruct them not to write their names on the questioimaires. 
Explain to them that this guarantees that their naw^s will not 
.be associated with what they write, so that they can be more 
free to write down whatever answer they feel is the best one. 

5, Ask the students not to spend a great deal of time on each question, 
but do emphasize that they should try to complete the questionnaire 
to the besc of their ability, 

6. Ask the students to follow directions carefully when they are 
asked to circle, check, write an answer, etc, 

» 

7« Read the questions clearly and slowly so that maximum compre- 
hension is attained. Repeat each question if it seems appro- 
priate. 

6« Occasionally suggest that the students write down their own 
ideas rathet* than copying someone else^s paper. 



« 
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Teadjef *s nsm^ 
Boy 



Check 



SUCCESS QUEStlONNAlRH 
the box which best describes how you feel about success, 



Success seaiis: 
I . working hard 

2. doing what you like to do 

3. doing a jo^ that other |>eople think is iftpottant 
4l getting a jd} done 

5, beting f asious 

6. feeling good after finishing a j<* 
71; doing a job well 

8> Nhat was the name of the man in the program?^ 



1 



not sure 



no 



9. liBtat did success »ean to the »an in the program? (Check more than one). 
. Q getting paid well for a job 

C3 choosing what he wanted to do ' 

£2 working his way up in the post office 

C3 justing out of airplanes 

Zl working hard on a foro 

CI woriiing on a job where he used his talents 

Q doing what he enjoyed 

10* The man in the program made several decisions. When did he have the chance to 
make decisions? (Check (vO more than one.) 



C3 in the arny 
CH on the farm 
C] in the post office 



C3 in the leather shop 

O in the airplane 

C3 with the sdiool gang 
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EOPQ 



SI. aii€€fS9 mm^ diitermt thiit^ at different tises in pmt 
lih«R the fiMii in tike j^rogriiB was iA hi^ ackool success was t 

□ working OA a faxa □ getting good grades 

EH being good at footbair * £3 driving a big car 
E3 .going to coHege G winning an art prije 

C3 having lots of friends . □ having lots of money 

12. Think s^oii;t a time when you were success fill at smithing. Hc^r did 
you know you were success fill „ ' 



15. iftiat does success mean to you? 



Finish the santence 
14. The best part of the program is 



15. The worst part of the program is 



16. the parts of the program I would change are 



ERIC 
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POST-VISfI!IQ ACTIVITY 



1, Did the ttacher appear to hav^ done any advanced prepariatibn 
for the program? yes n o 

Comments 



2. If a class discussion was the fbllow-ap activity (or part of 
the foUpw- up activity), please rate the discussion on the 
following scales: 



teacher 
doffilnated 1 



student 
dominated 



dealt only 
with program 12 3 



dealt only 
5 6 7 with concepts 



length of discussion: 



minutes. 



Comment : 



3. Describe the nature of the discussion and record briefly what 
happened in the classroom. (For example, "teacher talked for 
a few minutes about ways to earn money, student interrupted 
with a question about Monica's sister....") 



4. If activity, other than a discussion took place, please give 
a running account of the activity and the total time used. 



ERIC 
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Dat e • ' : :^ 

[ : "SltCCRSS STORY" TEACHEB (^OBSTIOmfAlRE 

BACKGaOUND 

' 1 . ' Gra'le l^ve l 2, Number of student s 

.^i^.Y teaching experleru-e: years. 

^, Years of experiefioe usins>lassroom televlalon; yearaV 

1.. How many different television programs dees your class view durlnff 

an HVi^rn^re Week? 

1- z7 ^ 3 4/7 5 z7 6 Z7 7 or more ^' ■ . 

OBJECTIVES 

Would you pLeaso rate each of the program's objectives (listed below) 
on. two •rlt*?rla--;(H) their value and importance to your teaching 
activltien, and (b) how close the lesson came to achieving each 
... poJ«ctive. Circle the number which best reflects your feelings. 

1. The studtjnt will cite examples of individuals who may be considered 
. ,sucoe;~sful in different ways and give several criteria which 

distin|.';uli3h their success. 

. Or) Important 1 -i 3 b 6 7 unimportant 

(b) achieved 1 2 3 s 6 7 not achieved 

2. The fltudent will give several .-riteria of success which he considers 
appropriate for himself at this time of his life. 

(h) important 1 ^ ^ b 6 J unimportant 

(b) cichieved 1^3 n «> 6 7 not achieved 

3. The student will give an example of when one may be successful, 
though not. considered so in the eyes of others. 

(ix) important 1 d S ^ ^ 6 7 unimportant 
(b) achieved 1 2 3 h 56 7 not achieved 

•'^ The student will dejTribe «n experience where he was considered 

su'-cessful in the eyes of others, but not in his own eyes and report 
why and how he felt. ^ 

(b) import -mt 1 2 3 5, 6 7 unimportant 

(b) achieved 1 2 3 b C 7 not achieved 

PROGRAM 

1. How would you rate your students' interest in the program? 

z7 very high ^ Z7 low * 

^ . . . ^ average 

1/ hi^n ^ very low 

(over) 



Comments : 

ERIC 



Conments : < ccint . } 



Would you use this program again with your class if you were 
teaching a unit on career development? 

O yes £7 1 don't know O no 

Comments:. 



Were the topic, content, and vocabulary levels of this program 
appropriate for your class? 

£7 appropriate Z7 I don't know ^inappropriate 
Comments: 



Were there any portions of this program that appeared to be 
particularly effective or meaningful? Please comment. 



Were there any portions of this program that seemed especially 
inappropriate or distasteful to you or your class? Please comment. 



Judged against other school television programs you have used» 
this program is: 

O superior £7 below average 

£7 average 

a above average £7 bottom of the barrel 

Have you any additional commentis on the program and its utility 

in your clas«?room? Please express your opinion as fully as possible. 
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date 



TEACHERS' EVALUATHJff OF bfsT COPY AVAlUBl £ 

THE TEACHEfi 'S GtllBE et>i uwr 



ow much (%) of the Teacher* s Guide for this program did you read? (Please 
>e honest.) 

6% X0% 20% 10% K0% S0% 80% 70% 80% 9&% 100% 



lease answer the following questions as fully as you can, based on the 
arts of the Teacher's Guide which you have read. 

U Does the '^synopsis'* accurately summarize what you saw in the program? 

O yes O I'ffl not sure Q no 

?, Are the "before the program" suggestions: 

appropriate? D yes O no 

useful? ^ yes H no 

would you use them O yes Z7 no 

a. Approximately how much time do you think these pre-program activities 
wduld take? ' minutes. 

Comments: 

[ 

. Are the "things to consider" 'questions : 

appropriate? /7 yes Z7 no 

useful? /7 yes £? no 

would you use them? O yes O no 

a. Approximately how much time do you think these "things to consider" 
questions would take in a post-viewing discussion? _ _ minutes. 

« 

Is this: 

O too much Q enough D too little 

Comments: 

Are the "short-term" recommended activities: 

appropriate? D yes £7 no 

useful? /7 yes £7 no 

would you use them? CT yes P no 

id . (PLEASE TURN) 



Wcml4 you cpnti^r using thi,? program in siOjjedt aroas .other thdn 
career educat idiriT Which areas and on what basis would ydu choose? 



Is it useful to have a two-level guide for one program? 
Please 'COfflment . ■ ■ ■ ' ■ 



Which level would you choose for your class? On what basis would your 
decision be made? 



Are there anv suggested questions or activities which are particularly 
inappropriate or worthless? Please conunent. 



Are there any suggested questions or activities which you find 
particularly valuable or appropriate? Please coiament. 



Are there any additional activities or questions which you feel should 
be included? 



Would you add any other comments about the Teacher's Guide? 



\ 
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PACKET C* 
(pre-program administration) 



This packet is to be used primarily before showing the 
ti?levision program: 

This packet contains: 

* 1 Observer's Class Profile (green) . , . . . pp. 91 

* 1 Instructions for Baseline Interview/ 

Interviewer's Questionnaire (yellow) . . , pp.113 

* 1 Baseline Interview Schedule (BLSI) (white) pp.115 

1 Instructions for Baseline Questionniare 

(green) ..... pp. 117 

*30 Baseline Questionnaires (BLQ) (white). . . pp.119 

2 Attention Profile System (pink). . . ... pp. 93 

* 2 Attention Profile Forms (pink) ...... pp. 95 

* 1 Teacher Que St ionnare (white) . ...... . pp.107 

* 1 Teacher's Guide Teacher Evaluation (blue), pp.109 



* Please Return * Pieces to: 

Saul Rockman 

NIT 

Box A 

Blooraington, Indiana U71+01 



* Does not duplicate material in Packets A and/or B. 
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^^^^^ Interview, please coa^lete the questionnaire on other sl4e* 



EVALUATORS ' INStRUCTIO'NS FOR KV^VV>^ 
BASfiUNE STUBEKT INTERVIEW (BLSl ) ^-^^^ 



1. mom the things to accomplish during the first few minutes in the 

classroom ig to select three (3) or four (4) stu(?ents to be interviewed'. 
Obtain the name of every seventh student on the teacher's i-ol^book. If 
the. child -is present. If absent, continue to the next seventh chl la. 
Return oack, to the beginning of the rolebook until three or four 
students are obtainej.1 (Ue., in a class of 25, select numbers 7, X4, 
21, 3> 10, etc. until three or four students present are selected). 

^* f $° other person beginning the baseline questionnaire, request 
the selr^cted students to follow you to a predetermined interview area — 
a separate room, if possible. 

3. introduce yourself to the students if they have not met you before. 

4. J^^^^^^^ the students that you are there to find out whit they know and 
- ■ how they feel about certain things. 

5. Assure the students that the interview is not like a test and therefore 
there are no right or wron??; answers to the questions. Tell them that 
^^^y wiil receive no grade for their answers. Explain to their that 
their names will not be associated with what they say, so that they 

. can be more free to give whatever answer they feel Is the best one. 

6.. When interviewing the studenta, use the intervl 'w form as a guide. 
Strict adherence to the wording of the' questions is not required. 

7. When students have difficulty In responding, it is appropriate to probe 
using questions that will help them to formulate responses, however, 
iili^ 4g£§. '^Q^- tngan . that you are to F,iye them answers to the questions 
so that they will a^^reo or disagree with the options you have provided . 

8. You will be interviewing several students at a time.. You will have to 
use your .judgment in writing down a consensus of the responses as well 
as any unusual Individual responses. Try to capture as many of the 
students' own phrases as possible. 

9. Return the students to the classroom, thanking them for their cooperation. 




(PLEASE TURN) 



FRir 



INt^EVIEWER'S QUESTIOIfMAIRE 

: ^ 

1. Did the responses obtained during the interview come primarily from: 

£y one student 

two of the students 
£7 all but one of the students 

spread fairly evenly aaong the students 



Coionents: 

2; How accurately did you record the students words? 

paraphrase 1234S6789 10 exact words 

Coniatents : 



3* How much (%> of what was said were you able to record? 

0% 10% 20% 30% ^0% S0% &0% 70% 80% 90% 100* 

Comments: 



^. Please note any additional information or observations of the 
students which would help in analyzing your interview data; 



S? What questions did the students ask you? 



6. Have you any comments on the interview in general which would help 
in analyzing the interview data? 
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SUCCESS PRE- VIEWING STRUCTURED INTERVIEW 
; 1. What do you think succeaa really means? 



2, Success means different things at different times in your life. 
If you were in high school vshat would success mean to you? 



3. Do you know anybody who feels successful, even though other 
people don* t think he is? Tell me about hi© or her. 



4» Tell me about a time when you were successful at something. How 
did you know you were successful? 



(PLEASE TURN) BLSI 
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page two 



.H-iVo you ever <1one som^^thinr, and everyone told you that you 
w-re 3Uv!eessful, but you didn't think so? T^H me about it. 
yolf r b t^i'^ f*^^ ^''^^^ werenU successful? How did 



'6. ■ What does success mean to you? 



BL3I 
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E VALUATORS* INSTRUCTIOMS 
for 

BASELINE QUESTIONNAIRE (BLQ) 



1. Introduce yourself to the students if they have not mat you before. 

2 . Tell the students that you are there to find out what they know 
and how they feel about certain things* 

3> Assure the students that the quest ionnarie is not a test and 

that there are no right or wrong answers to the questions* Tell 
them that they will receive no grades on the questionnaire. 

Instruct them not to write their names on the questionnaires. 
Explain to them that this guarantees that their names will not 
be associated with JiAmt they write, so that they can be more 
free to write down whatever answer they feel is the best one. 

5. Ask the students not to spend a great deal of tiro on each question t 
but do es^hasize that they should try to coi^lete the questionnaire 
to the best of their ability. 

6. Ask the students to follow directions carefully when they are 
asked to circle, check » write an answer « etc. 

7. Read the questions clearly and slowly so that maxifflum cos^re- 
hens ion is attained. Repeat each question if it seems appro- 
priate. 

8. Occasionally suggest that the students write down their own 
ideas rather than copying someone else*s paper* 
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Teacher's name ' ■ , 

^oy^ \ ■ gir l 

SUCCESS QUESTIONN/HRE 
ChecK (v<) the box which best describes how you feel about success. 



Success means: y^g 


not sure 


no 


1. 


Working hard /~7 




£7 




doing what you like to do 


LJ 


LJ 




taping a Job that other people think is important 


a 


n 




getting a Job done 




a 




being fanjous 


O 






feeling good after finishing a Job 


O 


a 


7." 


doing a Job well /"y 


£7 


o 


8. 


Think about a time when you were successful at something. How 
you know you were successful? 


did 



9. What does success mean to you? 



10. 



Success means different things at different times in your life. If 
you were In high school, what would success mean? (Check (v^) more 
than one . ) 



/ / working on a farm 

/ / being good at football 

/ / going to college 

/ / having lots of friends 



/ / getting good grades 

/ / driving a big car 

/ / winning an art prize 

/ / having lots of money 
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